beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Complete the removal of aggregators from Spark runner.
- Watermark can become unavailable for executors while it's updated with new values
- InMemoryStateInternals MapState / SetState should use StructuralValue for membership / key comparison checks
- ParDo should indicate what "features" are used in DisplayData
- Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource
- SerializablePipelineOptions should not call FileSystems.setDefaultPipelineOptions.
- Update GCSFileSystem to support glob patterns of the form {x,y,z}
- Revisit GroupByKey.createWithFewKeys
- IO tests should exercise Runtime Values where supported
- failIfNoTests: causes issues when trying to run integration tests
- Docs
- Java not yet supported