dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported8 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Support for n-dimensional partition definitions
- Dagster-Snowflake: private key not accepted unless base64-encoded
- [pythonic config] Add ability to create bool EnvVars
- Dagster daemon consumes too much memory
- Dagster Slack should allow to specify monitored assets and not just job
- Materialization with updated data version on external asset does not result in downstream asset marked as "Unsynced"
- Allow EnvVar value to be set or ConfigurableResource fields to be marked as secrets
- Behavior of `output_required` and materialization of downstream assets is unexpected
- Fivetran `load_assets_from_fivetran_instance()` does not support tags
- QueuedRunCoordinator does not handle run tag and op tag concurrency limits correctly together
- Docs
- Python not yet supported