beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
- Support MapState in DataflowRunner
- Create a dockerized developer environment for Beam
- Source.getDefaultOutputCoder() - hard to implement for adapter style sources
- Give new DoFn the ability to output to a particular window
- Consider merging KeyedPValueTrackingVisitor with DirectGraphVisitor
- io/google-cloud-platform should not depend on runners/dataflow for testing
- Assert over metrics sent to Graphite
- java DataflowRunner should warn if the stagingLocation has a TTL
- Trigger postcommit builds on Github push notifications
- Docs
- Java not yet supported