prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Workers are not honoring deployment concurrency limits during poll time
- Event persister drops a whole batch when one event contains a null byte (PostgreSQL)
- [UI] Improve flow runs timeline x-ticks
- Cached task runs wait for a tag concurrency slot before the cache lookup
- Releasing a concurrency slot doesn't wake waiters in the same process, so the slot sits idle until their Retry-After expires
- Preserve deployment schedule ids on upsert to prevent duplicate scheduled runs
- Flow ends COMPLETED when it returns a list of .map() results containing a FAILED task (states nested one level are ignored)
- Mapped children not yet started leave no task run when PrefectFutureList.result() raises the first failure
- Allow List vs Deny List for ACLs
- mark_deployments_ready updates every deployment on a queue on every worker poll
- Docs
- Python not yet supported