pyspark.SparkContext.getJobTags

SparkContext.getJobTags() → Set[str][source]

Get the tags that are currently set to be assigned to all the jobs started by this thread.

New in version 3.5.0.

Returns
set of str

the tags that are currently set to be assigned to all the jobs started by this thread.

See also

SparkContext.addJobTag()
SparkContext.removeJobTag()
SparkContext.clearJobTags()
SparkContext.cancelJobsWithTag()
SparkContext.setInterruptOnCancel()

Examples

>>> sc.addJobTag("job_to_cancel")
>>> sc.getJobTags()
{'job_to_cancel'}
>>> sc.clearJobTags()

previous

pyspark.SparkContext.getConf

next

pyspark.SparkContext.getLocalProperty