beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Python Dataflow integration tests should export the pipeline Job ID and console output to GHA Test Result section
- Improve memory profiling for users of Portable Beam Python
- FlinkRuner: Pipeline using KafkaIO seems not be able to terminate
- BigQueryWriteClient in DatasetServiceImpl is not closed, which causes "ManagedChannel allocation site" exceptions
- PubsubIO.readAvroGenericRecord creates SchemaCoder that fails to decode some Avro logical types
- Run Github Actions on GCP workers in the apache-beam-testing project
- Flink testParDoRequiresStableInput flaky
- Investigate load state_dict vs loading whole model
- Support for reading Kafka topics from any startReadTime in Java
- Migrate exclusively to the v1 progress/metrics API
- Docs
- Java not yet supported