spark
https://github.com/apache/spark
Scala
Apache Spark - A unified analytics engine for large-scale data processing
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Scala not yet supported76 Subscribers
View all SubscribersAdd a CodeTriage badge to spark
Help out
- Issues
- [WIP][POC][GRAPHFRAMES] Add GraphFrames as an in-tree Spark module
- [SPARK-59020][SQL] Support DSv2 Parquet shredded Variant predicate pushdown
- [K8S] Extend avoidDownloadSchemes to spark.files so executors can read uploaded files directly
- Github workflow for scanning CVEs
- [SPARK-59018][SQL] Add variant_array_length expression
- [SPARK-58021][CONNECT] Add forceful local pool purge
- [SPARK-XXXXX][SQL] Reuse AttributeSeq when normalizing a sequence in QueryPlan canonicalization
- [SPARK-58979][SS] Preserve event time through streaming dedup pruning
- [SPARK-58982][PYTHON] Remove unused _is_namedtuple_ attribute in serializers
- [SPARK-58970] Defer LeftSemi/Anti join pushdown through Aggregate to after scan pushdown
- Docs
- Scala not yet supported