prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Allow use of `dbt retry` for targeted retries.
- Feature-request: add an option to write dbt profile to a tmp directory
- Copy environment variables to task worker
- Flow run fails when dask scheduler raises `KilledWorker`
- Update Flow Run from "Running" to "Failed" if Dask cluster prematurely terminates
- support api key authentication for `KubernetesCredentials`
- Error in test suite
- Specifying resources for task causes flow to fail/crash
- prefect worker start with resources ?
- Flow code executes before dependencies present on Ray cluster
- Docs
- Python not yet supported