dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported8 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Make op selection work with nested graphs
- Calling .alias() on an OpDefinition and including it in the node_defs of a GraphDefinition raises an error.
- handle multiple asset materializations per asset_sensor tick
- A way to call dagit logger within a subprocess
- enable supplying run config values directly, instead of a yaml path, on CLI
- Job/Graph default root input manager
- Graphs should support yield
- Easy to get into confusing situations when multiple schedules in the same repo have the same name
- [Content Gap] document the resource factory pattern as a solution for default config and resource remapping
- [docs] - Google Cloud deployment with Helm charts + GKE Workload identity
- Docs
- Python not yet supported