prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- feat: added option to persist auto-generated Dockerfile
- Add VolcanoWorker to support Volcano Job submission via Kubernetes work pool and test
- Incorrect dbt profiles dir setting resolution logic in `PrefectDbtSettings`
- Enable submission of tasks and flows to remote infrastructure without previous registration
- 'No module named ...' when referencing external files from flow with DaskTaskRunner
- Deleting a deployment does not delete corresponding scheduled runs
- Consider adding DB cleanup scripts to save space in Postgres
- Importing prefect kills uvicorn app's log messages
- Logging from function that uses multiprocessing are not streamed to the UI console
- Github.get_directory() is resolving symlinks and copying files when deploy to local filesystem
- Docs
- Python not yet supported