prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Allow getting result from subflow with return_state = True without persisting
- Automation: Ability for result of a completed Flow Run trigger to be passed to a Deployment Run action's parameters
- Handle failed kubernetes scheduling events more gracefully
- Allow src/prefect/results.py DEFAULT_STORAGE_KEY_FN to be overwritten at infra level
- Log a warning/raise error if user tries to cache something undeterministic (uncacheable)
- Importing Prefect is slow
- Add a toggle to the UI that allows the user to visually hide/show certain `@task`s
- Add deployment status events on deployment edit and creation
- How can I use Docker Worker with ECR login?
- Cannot stream logs from a running container using `get_docker_container_logs`
- Docs
- Python not yet supported