airflow
https://github.com/apache/airflow
Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported33 Subscribers
Add a CodeTriage badge to airflow
Help out
- Issues
- `airflow tasks run` cli creates a kubernetesJobWatcher when running task with CeleryKubernetesExecutor
- Airflow scheduler and worker memory spikes when a dag is run with large run config
- Datasets should have allowed_states parameter
- FileTaskHandler has set_context but, it is no longer used.
- View to see all Jobs (SchedulerJob, LocalTaskJob, etc) in AIrflow 3
- Explicitly marking a DAG as FAILED does not force termination of related DAGs
- Dataset Aware scheduling ignores catchup and leads to surprising behaviour when downstream DAG is deactivated
- Support reading and writing xcoms to the Airflow API server from go sdk (edge mode)
- Handle custom xcom backends with go sdk (edge mode)
- Add support for TI state transition apart from success / failed (edge mode)
- Docs
- Python not yet supported