beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported55 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- In TriggerRunner, avoid reading the set of finished subtriggers when no subtrigger ever finishes.
- Support Google Cloud Storage encryption keys
- Support for limiting parallelism of a step
- Support side inputs for Sessions
- When triggers are changed via pipeline update, stale finished triggers data applied
- Model for validation of user state upon pipeline update
- Merging of watermark holds depends on runner-specific "take the minimum" behavior
- Add SocketStream IO
- Add declarative DSLs (XML & JSON)
- Create OSGi/Karaf runner
- Docs
- Java not yet supported