beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported57 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Validate UDF/UDAF types on creation
- Add retry policy to Python BQ streaming sink
- Update Bigtable dependencies
- Create unit tests for BeamQueryPlanner.convertToBeamRel
- Consider how to free state with unbounded keys in the global window
- Conditionally propagate local GCS credentials to locally spawned docker images.
- Distinct has bad parallelism characteristics
- Potential issue with QuantileStateCoder
- Beam performance degraded significantly since 2.4
- Evaluating Big Data Gateway - Data Ingestion from 1 million IoT Devices every 500 milli seconds (telemetry data) into Data Lake
- Docs
- Java not yet supported