prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- Multiprocessing in Prefect tasks causes deadlock if workload cannot be pickled
- Add the possibility for an internal rate limiter for `task.map(...)`
- Creating flow run from deployment fails with Pydantic 2 parameters
- Expose additional functionality on the cli deploy command to prevent redundant build steps
- to_deployment causes infinite Pending state for other flows importing the same module
- Issues with outputs capture (AssertionError: feed_data after feed_eof)
- Failed to load collection prefect_dbt when loading prefect_snowflake
- `with ShellOperation` context block results in error
- Not Connecting with Azure Databricks
- Allow users to select and invoke flow runs with Blocks when using Block as a param type hint
- Docs
- Python not yet supported