prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- When a process worker goes down, mark running tasks/flows as "Crashed"
- `prefect deploy` should validate yaml file before deploying
- incorrect image tag for auto-generated Dockerfile
- Allow `cluster_kwargs` to be provided via config
- Kubernetes agent log (perhaps fail?) when jobs are rescheduled
- Add support for `rrule`-based schedules to deployments from the UI
- Add `prefect server status`
- Flow runs duplicated when DST ends (v2)
- Give a way to keep a set of files for a deployment and the remote storage in sync.
- Flows with "Crashed" subflows that exceed flow timeout stuck in "Running" state
- Docs
- Python not yet supported