beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported60 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Be able to specify the Spark Partitioner via the pipeline options
- Update BigQueryIO to support schema auto detection when executing load jobs
- Update Documentation of BigQuery source/sink to include the exact format of data read/written
- Retry downloading required test artifacts with a backoff when download fails.
- BagState.isEmpty needs a tighter spec
- Logs from python custom commands are not visible at installation time
- Map and Multimap views should use structural value for equality comparisons instead of Java equality
- Factor execution time and construction time dependencies into a non-SDK component
- TextIO.withoutSharding sets shard template name to empty string instead of null
- AfterProcessingTime trigger doesn't create any file panes
- Docs
- Java not yet supported