prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Task parameters that are dataclasses with init=False fields fail to resolve
- Preserve init=False dataclass fields in visit_collection
- Align flow runs timeline ticks to local time boundaries
- Read and write deployment files as UTF-8 regardless of the platform encoding
- Keep month and year interval schedules as calendar intervals in the client
- Warn and skip invalid profile values instead of failing every command
- Carry exception arguments through JSON serialization
- Add support for Armada Multi-Cluster Batch System as a worker pool type
- Add work pool support for Armada (K8s multi-cluster) batch system
- add ability to background prefect worker
- Docs
- Python not yet supported