beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported60 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Bug]: When using FnApi and DataStream, bundle processing is not isolated due to limited queues and multiplexing
- [Feature Request]: Add max_read_time to ReadFromPubsub similar to ReadFromKafka
- Handle multi-key bundles in side-input runner
- [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails consistently (io expansion-service shadowJar not found)
- Add unit tests to Go harness package (issue #21386)
- [Task]: Use the new Iceberg FileFormat API
- Portable VoidCoder
- [Failing Test]: Milvus RAG integration tests fail consistently in beam_PreCommit_Python_ML (py3.13)
- [IcebergIO] Let hash distribution mode spill over if file gets too large
- [Dataflow Streaming] [Multi Key] Drop failed work in BoundedQueueExecutor::pollWork
- Docs
- Java not yet supported