dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- [docs] - Asset keys must be globally unique within a deployment
- enable run status sensors to process multiple runs per tick
- [docs] - Document branch deployment IO pattern that loads from master and writes to branch schema
- graph-backed assets use description from first op in graph
- Resources provided on assets show up on asset jobs that don't require it.
- Add an easy way to tell what asset keys have been materialized in the current run
- [docs] - graphql docs reference pipelines
- enable a sensor to indicate that it took some action without launching a run
- enable annotating arguments to op-decorated functions with `Callable`
- in run failure sensors, make it easy to get the step failure stack traces
- Docs
- Python not yet supported