beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
View all SubscribersAdd a CodeTriage badge to beam
Help out
- Issues
- Pickling error when pickling a nested function
- Merge, Split, Delay, and Reorder bundles in the DirectRunner
- Streaming BigQueryIO should support user-provided IDs
- Trigger AST should use @AutoValue
- Replace Xyz.INSTANCE throughout the SDK with either static methods or XyzFactory.default()
- Data locality for DoFns
- ParDo should validate window merging against StateSpec being auto-combinable
- Update Read PTransform to implicitly use maxNumRecords and maxReadTime
- Make BZIP compressed files splittable
- Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story
- Docs
- Java not yet supported