spark
https://github.com/apache/spark
Scala
Apache Spark - A unified analytics engine for large-scale data processing
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Scala not yet supported76 Subscribers
Add a CodeTriage badge to spark
Help out
- Issues
- [SPARK-56907][SQL] Reduce per-value skip in DELTA_LENGTH_BYTE_ARRAY Parquet vectorized reader
- fix issue MapType as a type hint for schema 55900
- Pyspark: `from_json` is missing `MapType` as a type hint for `schema` argument
- [SPARK-44734][PYTHON][DOCS] Expand PySpark type conversion guide
- [WIP][CONNECT] Support directory uploads in Spark Connect copyFromLocalToFs
- [SPARK-56468][UDF] Validate required worker capabilities in direct dispatcher
- [SPARK-56891][CONNECT] Propagate Spark Connect session user as a SparkContext local property
- User Defined Functions crash Spark Dataframes created directly, but not for ones made from Pandas on Spark.
- Feature request: inferSchema do not infer digit strings that start with 0 as integer
- [SPARK-55792][PS] Optimize DataFrame diff axis=0
- Docs
- Scala not yet supported