Package org.apache.spark.util

Class SparkClosureCleaner

Object

org.apache.spark.util.SparkClosureCleaner

public class SparkClosureCleaner
extends Object

Constructor Summary

Constructors

Constructor	Description
SparkClosureCleaner()

Method Summary

Modifier and Type	Method	Description
static <F> F	clean(F closure, boolean checkSerializable, boolean cleanTransitively)	Clean the given closure in place.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkClosureCleaner

public SparkClosureCleaner()

Method Details

clean

public static <F> F clean(F closure,
 boolean checkSerializable,
 boolean cleanTransitively)

Clean the given closure in place.

More specifically, this renders the given closure serializable as long as it does not explicitly reference unserializable objects.

Parameters:

closure - the closure to clean

checkSerializable - whether to verify that the closure is serializable after cleaning

cleanTransitively - whether to clean enclosing closures transitively

Returns:

Cleaned closure if it was actually cleaned or the original closure otherwise