dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- memoization without versioning
- timeouts when loading a single repository location containing 1000+ pipelines
- When using K8s display op pod name in Dagit UI, not just the job name
- When loading an input FromSourceAsset, the metadata on the input context may differ from the original output metadata
- Improve the error message when using local filesystem io manager in remote setup
- Lineage for dynamic assets
- On sensor page for asset sensors, show upstream assets that the sensor depends on
- Configurable classes used for dagster.yaml values should use StringSource/IntSource rather than str/int in their config scheamas.
- Required resources of DagsterTypeLoaders are not surfaced when the dagster type is wrapped in another type (e.g. List)
- run_status_sensor for multiple statuses at once
- Docs
- Python not yet supported