beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported57 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Change default SDK worker parallelism to use the number of cpu cores
- Add tests for AzureBlobStoreFileSystem match
- BeamSideInputJoinRel should swap nodes in the Rule, not in expand
- Group.<Row>globally().aggregate(Count.combineFn())) Throws Error
- SchemaIOProvider should differentiate between read-only and write-only configuration
- Optionally use containerized workers in fn api runner
- Make Spark validates portable runner batch a precommit
- tests fails on windows - pandas_doctests_test.DoctestTest
- Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts
- Add support for self-referential Beam schemas
- Docs
- Java not yet supported