prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- `db_vacuum` Docket jobs run concurrently against a size-1 maintenance pool and time out hourly
- Add an endpoint for resolving a flow run’s job specification
- SIGTERM race in `flow-run execute` reschedule mode can strand a run in AwaitingRetry forever (retry_type='in_process' with no live process)
- Consider supporting httpx2 alongside httpx
- `db_vacuum` on high-volume Postgres: events and flow_runs contend for one hardcoded connection, and row DELETE cannot promptly reduce disk usage
- [docs] Document when and how to independently scale Prefect background services
- Renovate Dependency Dashboard
- on_crashed hooks silently skipped on process work pools: runner signals completion before running hooks, worker deletes the cwd
- Add pending-claim self-healing for flow runs stuck in `PENDING`
- azure_container_instance do not Support GPUs
- Docs
- Python not yet supported