dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Enhanced Failure Management: Mid-Run Asset Restart or Forking with State Preservation
- Assets wrapping some ops made by integration libraries have `start_after` asset upstream, with no way to remove it
- How do I create an job with one asset and its dependencies(upstream) ?
- enable supplying run config to observable source assets
- Absolute file path as partition key overwrites original file
- Serializable meta-value
- Improve Large Backfill Submission UX
- Dagster CLI does not support turning the auto-materialize daemon on/off
- Materialize/Backfill missing partition for a selection of assets with different partition definitions
- Allow to set default value for `EnvVar`
- Docs
- Python not yet supported