dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Make Dagster run monitoring also clean up pending pods for pods that are left in a pending state
- Enable skipping downstream steps when runtime data version is the same as previous
- Support branch deployment promotion and/or blue-green deployments
- Rolling window partition dependency provides wrong time windows when start_date from downstream asset after upstream start_date
- lazy auto-materialize skips missing asset with freshness policy downstream of materialized assets
- Top level definitions config is not merged with job level config
- render a materialization lineage graph
- tags property in GraphDefinition.to_job annotated Mapping[str, str] docs say Mapping[str, Any]
- enable requests to add and delete dynamic partitions from schedules
- ssh resource connection fails when using password
- Docs
- Python not yet supported