prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Prefect causes memory leak in Dask scheduler when connecting to an existing scheduler
- Add `replaces` field for renaming deployment names
- Handle Dask worker-loss task failures
- Task not marked as Failed when task fails consistently in Dask Cluster
- Add a --dry-run switch or equivalent to prefect deploy
- _cancel_run skips kill_infrastructure for running flow runs, leaving zombie pods indefinitely
- Prefect HA setup - Observed DeadlockDetectedError when task-run-recorder background service running one instance each on two Kubernetes Cluster
- Prefect HA setup - Task run recorder event is not reached to Redis, but server log say event is published.
- Allow filtering flow and task runs by both state type and state name
- Markdown description can be hidden on pause_flow_run input box
- Docs
- Python not yet supported