Choose a Spark release:
Choose a package type:
Verify this release using the and project release KEYS.
Note that, Spark is pre-built with Scala 2.11 except version 2.4.2, which is pre-built with Scala 2.12.
Preview releases, as the name suggests, are releases for previewing upcoming features. Unlike nightly packages, preview releases have been audited by the project’s management committee to satisfy the legal requirements of Apache Software Foundation’s release policy. Preview releases are not meant to be functional, i.e. they can and highly likely will contain critical bugs or documentation errors. The latest preview release is Spark 3.0.0-preview2, published on Dec 23, 2019. You can select and download it above.
Spark artifacts are hosted in Maven Central. You can add a Maven dependency with the following coordinates:
groupId: org.apache.spark artifactId: spark-core_2.11 version: 2.4.4
PySpark is now available in pypi. To install just run
pip install pyspark.
As new Spark releases come out for each development stream, previous ones will be archived, but they are still available at Spark release archives.