prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Do not re-enqueue DBT job when unexpected exception is raised in wait_for_completion
- Long running node timeout
- Allow use of `dbt retry` for targeted retries.
- Feature-request: add an option to write dbt profile to a tmp directory
- wait_for_dbt_cloud_job_run fails if run is not yet created
- Copy environment variables to task worker
- Flow run fails when dask scheduler raises `KilledWorker`
- Update Flow Run from "Running" to "Failed" if Dask cluster prematurely terminates
- Task Recursion with DaskTaskRunner in k8s
- Failed to unpickle WindowsPath with Windows client and Linux cluster
- Docs
- Python not yet supported