prefect
https://github.com/prefecthq/prefect
Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to prefect
Help out
- Issues
- path is doubled during deployment. Subsequent flow runs fail.
- User project should allowed to be specified for requester-pays buckets
- job_config can't support "dict" type
- Add stderr to an exception object in ShellProcess if return code != 0
- Add a fail-fast option to `ShellOperation` for multiple commands
- Cancelling a task run with `.set_task_run_state`
- SnowflakeCredentials requires password even when using private_key to authenticate
- Returning query_id in various methods
- Issues passing in a private key for snowflake credentials block
- Allow embedding images
- Docs
- Python not yet supported