Spark 3.3.2 is a maintenance release containing stability fixes. This release is based on the branch-3.3 maintenance branch of Spark. We strongly recommend all 3.3 users to upgrade to this stable release.
.newInstance() in K8s module
spark.scheduler.mode=FAIR should provide FAIR scheduler
build/sbt should allow SBT_OPTS to override JVM memory setting
README.md from triggering CIs
lint job by skipping PySpark and SparkR docs if unchanged
flake8 tests if the command is not available
random data test
[SPARK-41185]: Remove ARM limitation for YuniKorn from docs
While being a maintenance release we did still upgrade some dependencies in this release they are:
org.tukaani:xz to 1.9
You can consult JIRA for the detailed changes.
We would like to acknowledge all community members for contributing patches to this release.