dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported8 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Asset with BackPolicy.single_run() and multipartition will sometimes create multiple job runs
- Graph asset config not visible in Dagster UI Launchpad.
- `partitions_def` attribute not automatically set in `define_asset_job`
- [dagster-polars][dagster-pandera] Pandera / polars IO Manager compatibility and optional partitioned upstream asset
- Improved concurrency management with pool slots equivalent
- [dagster-pandera / dagster-polars] Asset with Pandera Polars schema fails to be materialized with PolarsIOManager
- Logs generated during evaluation of sensor not shown in UI if they originate from within a configurable resource
- Custom freshness checks on dynamically partitioned assets
- Webserver at random times for random periods makes queries to dagster DB that drive CPU usage to near maximum
- [dagster-dbt] Add selective materialization of views at runtime.
- Docs
- Python not yet supported