prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- wait_for_dbt_cloud_job_run fails if run is not yet created
- Copy environment variables to task worker
- Flow run fails when dask scheduler raises `KilledWorker`
- Update Flow Run from "Running" to "Failed" if Dask cluster prematurely terminates
- Task Recursion with DaskTaskRunner in k8s
- Failed to unpickle WindowsPath with Windows client and Linux cluster
- Pending K8s Jobs shown as failed in Prefect UI and may later run
- Add memory and cpu options as default fields in the Kubernetes workpool.
- Pod logs are retrieved before job is completed
- support api key authentication for `KubernetesCredentials`
- Docs
- Python not yet supported