prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- prefect-dbt `Path '/root/.dbt' does not exist.`
- Use `wait_for = []` with `quote()`
- Union of two Pydantic Basemodels "jumps" from Option to Option
- Ability to specify flow run creator by email and/or name instead of handle
- Allow setting of resourceRequirements in ECS Worker to enable GPU workloads
- Anchor_dates shift unpredictably when Interval schedules are off and on via the UI
- run_shell_script commands output/logs not visible on the UI
- Stalling with temporary cluster through Dask task runner
- Tasks running longer than timeout setting then failing
- prefect has a maximum serialized parameter size, and the failure mode is difficult to diagnose
- Docs
- Python not yet supported