prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Allow customized container name for k8s worker flows
- Allow global concurrency slot acquisition retries to be configurable
- Explore `PrefectHTTPClient` retries on `TimeoutError` as well as specific status codes
- Type annotation is missing for a @PrefectObjectRegistry.register_instances
- Pausing and resuming from within the same task execution in a .served flow causes Duplicate submission of flow run warning and flow run to hang.
- Generic flow and task hooks
- Add ability to set a PostgreSQL role prior to running migrations
- Filter out child flows in the "Dashboard View"
- Support custom tmp dir location in prefect_test_harness
- Azure Kubernetes Job never cancelled when image cannot be pulled
- Docs
- Python not yet supported