dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- conditional branching with map/collect
- configured on graphs
- idea: typed config and resources via function arguments
- Add storage_system_name or similar to software-defined assets
- io_manager_def on AssetOut
- better support for invocation of partitioned ops
- [dagit] Step status pane collapses if other sections update contents
- Support using rrule for defining schedule cadences
- [helm] setting fullNameOverride in global causes failures
- [dagster-aws] Allow users to configure server-side encryption for uploading s3 objects in emr_pyspark_step_launcher
- Docs
- Python not yet supported