dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Allow specifying PartitionMapping when non-asset jobs depend on partitioned source assets
- Run Monitoring should use DAGSTER_GRPC_TIMEOUT_SECONDS from the code location of the job that is being run, rather than the start_timeout_seconds on dagit/dagsterdaemon
- Raise a better error when observable source assets are used as arguments instead of non_argument_deps
- Dynamically schedule a run from the UI
- Creating multiple assets from the same configurable op using AssetsDefinition.from_op leads to confusing config scaffold
- Multi-select steps from Dagit UI
- Hierarchical / nested asset groups
- When `context` param is provided to composition function like `graph_asset`, give more informative error message
- Allow passing `executor` to `asset`, `graph_asset` and `graph_multi_asset`
- Enable box/lasso selection of assets in the DAG view
- Docs
- Python not yet supported