beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported65 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Python] Cache __hash__, fast_name, and _TypedMetricName on MetricName
- [Feature Request]: [Python/YAML] Add native Expect / data quality PTransform with tagged DLQ outputs
- [Feature Request]: [Streaming/YAML] Add declarative IntervalJoin composite transform with watermark skew circuit breaker
- [Feature Request]: [Kafka/YAML] Turnkey Confluent Schema Registry Wire Format deserializer in ReadFromKafka
- [Feature Request]: [Iceberg/Managed] Continuous unbounded streaming support in beam.managed.Write(ICEBERG) (Append & CDC)
- [Feature Request]: [Lakehouse/Python] Partition-aware zero-copy metadata translation from Delta Lake to Apache Iceberg
- [Java FnApi] Instead of enforcing 100 messages on grpc streams enforce a 100MB limit.
- [Feature Request]: Support BigQuery reservation for Java BigQueryIO FILE_LOADS
- Port ElasticsearchIOTest off DoFnTester
- Lazily initialize _default_environment in ExpansionServiceServicer
- Docs
- Java not yet supported