dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- pipeline_name is missing from log event records and console output
- [Content Gap] Audit contributing guide for Windows-compatibility
- Make it possible to not hold solids outputs in memory
- Periodic fetch and deploy new user code deployments
- [Content Gap] mention dagit proxy/corporate VPN workarounds
- Allow global configuration of K8sRunLauncher
- [Content Gap] Docker Deploy instructions with multiple Docker-compose services
- Zombie pipelines - force-rebooting machine with dagster daemon leads to dagit still thinking that solids are running
- Use tags to organize pipeline definitions in Dagit
- Improve tags view for pipelines
- Docs
- Python not yet supported