pyspark.SparkContext.setJobDescription

SparkContext.setJobDescription(value)

Set a human readable description of the current job.

Added in version 2.3.0.

Parameters:

valuestr

The job description to set.

Notes

If you run jobs in parallel, use pyspark.InheritableThread for thread local inheritance.