beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported65 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Feature Request]: [Python/Enrichment] Add file-backed lookup handler (CSV/JSON/Parquet) and error_handling / on_miss semantics to Enrichment
- [Python] Record timestamp before releasing statecache test threads
- [Python] Share embedding models across processes when large_model is set
- [Bug]: [Python] BundleBasedDirectRunner StateSampler.scoped_state caches MetricsContainer from Bundle 1, losing metrics in subsequent bundles
- [Feature Request]: [Python/YAML] Add schema-aware Deduplicate transform in Beam YAML with key columns, time domain, and duration
- Bump tar from 7.4.3 to 7.5.23 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel
- [Python] Update cached ScopedState metrics container per bundle
- [Python] Make Beam the only retry layer in AnthropicModelHandler
- [Bug]: Gemini and OpenAI model handlers set no default max_batch_size; default embedding requests exceed the API's 2,048-input limit
- Bump js-yaml from 4.1.1 to 4.3.2 in /scripts/ci/pr-bot
- Docs
- Java not yet supported