beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Feature Request]: Expose message publish time in Beam YAML ReadFromPubSub
- feat: Adds support for DATE, DATETIME and JSON BigQuery types in the Python SDK using Storage API
- [OpenTelemetry] Add an experiment to enable the instrumentation agent in Java's portability harness
- Report source lineage from HadoopFormatIO
- feat(io): Implement parallel reading in SparkReceiverIO (Fixes #37410)
- [Task]: Update Python slowly updating side input example
- [Bug]: Eliminate field sorting in Beam schema-aware transforms which can result in compatibility issues
- [KafkaIO] Replace end offset consumer with sum of Consumer.position(TopicPartition) and Consumer.currentLag(TopicPartition)
- [Java]:Add support for portable timestamp logical types (micros_instant, nanos_instant) in BeamCalcRel
- [Bug]: Iceberg managed connector upgrade failed in GCP Dataflow
- Docs
- Java not yet supported