Community

Have questions?

StackOverflow

For usage questions and help (e.g. how to use this Spark API), it is recommended you use the StackOverflow tag apache-spark as it is an active forum for Spark users’ questions and answers.

Some quick tips when using StackOverflow:

  • Prior to asking submitting questions, please:
  • Please follow the StackOverflow code of conduct
  • Always use the apache-spark tag when asking questions
  • Please also use a secondary tag to specify components so subject matter experts can more easily find them. Examples include: pyspark, spark-dataframe, spark-streaming, spark-r, spark-mllib, spark-ml, spark-graphx, spark-graphframes, spark-tensorframes, etc.
  • Please do not cross-post between StackOverflow and the mailing lists
  • No jobs, sales, or solicitation is permitted on StackOverflow

Mailing lists

For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.

Some quick tips when using email:

  • Prior to asking submitting questions, please:
  • Tagging the subject line of your email will help you get a faster response, e.g. [Spark SQL]: Does Spark SQL support LEFT SEMI JOIN?
  • Tags may help identify a topic by:
    • Component: Spark Core, Spark SQL, ML, MLlib, GraphFrames, GraphX, TensorFrames, etc
    • Level: Beginner, Intermediate, Advanced
    • Scenario: Debug, How-to
  • For error logs or long code examples, please use GitHub gist and include only a few lines of the pertinent code / log within the email.
  • No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.
Reporting security issues

Please see the Security page for information on how to report sensitive security vulnerabilities, and for information on known security issues.

Chat rooms

Chat rooms are great for quick questions or discussions on specialized topics. The following chat rooms are not officially part of Apache Spark; they are provided for reference only.

  • Spark with Scala is for questions and discussions related to using Spark with the Scala programming language.

Events and meetups

Conferences

The Spark Summit website archives at spark-summit.org, from years 2013 to 2017, are no longer available, so the links to them have been removed. Instead, we have most of the video recordings.

Meetups

Spark Meetups are grass-roots events organized and hosted by individuals in the community around the world. Check out meetup.com/topics/apache-spark to find a Spark meetup in your part of the world. Below is a partial list of Spark meetups.

If you'd like your meetup or conference added, please email user@spark.apache.org.

Issue tracker

The project tracks bugs and new features on JIRA. If you'd like, you can also subscribe to issues@spark.apache.org to receive emails about new issues, and commits@spark.apache.org to get emails about commits.

Powered by

Our site has a list of projects and organizations powered by Spark. Add yours by emailing `dev@spark.apache.org`.

Latest News

Archive