beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported65 Subscribers
View all SubscribersAdd a CodeTriage badge to beam
Help out
- Issues
- Fix flaky Java tests
- Restore thread interrupt status in InterruptedException catch blocks
- [Bug]: Unpersist cached Datasets after evaluation in Spark Structured Streaming runner
- [Bug]: Spark Structured Streaming Runner memory leak: Datasets are persisted but never unpersisted in `ParDoTranslatorBatch`
- [Feature Request]: Add support for Python 3.15
- Add Bigtable CDC YAML SchemaTransform
- [Java][BigQueryIO] Use schema ordinals as verified hints for TableRow descriptor lookup
- [Feature Request]: Implement least-privilege access for GKE workload hosting Beam metrics.
- Performance Regression or Improvement: gbk_python_batch_load_test_fanout_8_times_with_2GB_10byte_records_total:runtime
- [Feature Request]: Avoid per-field `Descriptor.findFieldByName` lookups in BigQuery Storage Write API TableRow conversion
- Docs
- Java not yet supported