beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported57 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- TestStream.testDiscardingMode gives wrong answer on FlinkRunner
- TestStream.testLateDataAccumulating gives wrong answer on FlinkRunner
- TestStream.testFirstElementLate gives wrong answer on FlinkRunner
- Implement FileIO/TextIO on top of Splittable DoFn
- WriteToFiles with a concrete sink can shunt data to a single window
- Consider adding MetricFiltering classes for metrics names with urns and labels.
- HistogramCell needs a few touches to make it match the spec :)
- Add Table statistics / Row estimation for ParquetTable
- DataFrame API: Consider allowing partitioning by column in addition to Index
- DataFrame read_* methods should allow globs that don't match any files in streaming pipelines if schema is specified
- Docs
- Java not yet supported