beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Schemas across pipeline modifications
- Support unknown fields in Rows
- Analyze FieldAccessDescriptors and drop fields that are never accessed
- Provide automatic schema registration for BigQuery TableRows
- Document the SDK contract for a PCollection having a schema
- Valildate that OutputReceiver<Row> is only allowed if the output PCollection has a schema
- Consider Schema.join to automatically produce a correct joined schema
- Review of schema metadata vs schema types
- Define & document the domain of Schema types prominently
- FieldType should be a proper algebraic type
- Docs
- Java not yet supported