dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported6 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- detect when an in-memory IO manager is used for jobs using dagstermill ops and raise a better error message
- We should add a lint rule that warns on subprocess.Popen
- Snapshot pages need to be more clearly defined
- add a dev job for the hacker news dbt graph
- More tests and data quality checks for the hacker news jobs
- tear down pyspark resource after a run ends
- [Content Gap] be more explicit in the celery-k8s docs that jobs need to be configured with the celery_k8s_job_executor in order to run
- Make io managers aware of execution environment
- Unpin pipenv version in pipenv smoke test
- occasional "'NoneType' object is not subscriptable" error in hacker_news_api_download
- Docs
- Python not yet supported