dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported8 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- enable run status sensors to process multiple runs per tick
- [docs] - Document branch deployment IO pattern that loads from master and writes to branch schema
- Resources provided on assets show up on asset jobs that don't require it.
- Add an easy way to tell what asset keys have been materialized in the current run
- [docs] - graphql docs reference pipelines
- enable a sensor to indicate that it took some action without launching a run
- enable annotating arguments to op-decorated functions with `Callable`
- in run failure sensors, make it easy to get the step failure stack traces
- enable specifying asset dependencies via direct object references
- importing dagster-pyspark raises deprecation warning
- Docs
- Python not yet supported