beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Multiple NeedsRunner tests break with Flink 'Cannot union streams of different types'
- Timer parameter not supported in timer callback
- Antipattern will break legacy dataflow python pipelines if a new cy_combiner is added and used in the python counter_factory
- Direct Runner loses checkpoint marks when committing offsets to Apache Kafka partitions using KafkaIO
- Spotless doesn't check build.gradle files
- Python SDK: Unable to obtain the PCollection for output tags which are not consumed by a downstream step.
- Python pipelines should not be able to use output tags that are not defined in with_outputs.
- BigQueryIO.write.withExtendedErrorInfo() does not catch missing tables (and maybe datasets)
- Wrong log severity in Dataflow logs
- Extract common User MonitoringInfo URN parsing logic.
- Docs
- Java not yet supported