beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Move website job definitions to main Beam repo
- PipelineOptions subclasses defined in the main session could be duplicated
- Implement real synchronized processing time in Flink runner
- DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
- Support MapState in DataflowRunner
- Create a dockerized developer environment for Beam
- Source.getDefaultOutputCoder() - hard to implement for adapter style sources
- Give new DoFn the ability to output to a particular window
- Consider merging KeyedPValueTrackingVisitor with DirectGraphVisitor
- io/google-cloud-platform should not depend on runners/dataflow for testing
- Docs
- Java not yet supported