package util
- Alphabetic
- Public
- Protected
Type Members
- trait BackoffStrategy extends AnyRef
A
BackoffStrategydetermines the backoff duration (how long we should wait) for retries after failures. - final case class BatchReadOptions() extends InputReadOptions with Product with Serializable
Options for a batch read of an input.
- case class ExponentialBackoffStrategy(maxTime: FiniteDuration, stepSize: FiniteDuration) extends BackoffStrategy with Product with Serializable
A
BackoffStrategywhere the back-off time grows exponentially for each successive retry.A
BackoffStrategywhere the back-off time grows exponentially for each successive retry.The back-off time after
nfailures is min(maxTime, (2 ** n) * stepSize).- maxTime
Maximum back-off time.
- stepSize
Minimum step size to increment back-off.
- sealed trait InputReadOptions extends AnyRef
Generic options for a read of an input.
- final case class StreamingReadOptions(userOptions: CaseInsensitiveMap[String] = EmptyUserOptions, droppedUserOptions: CaseInsensitiveMap[String] = EmptyUserOptions) extends InputReadOptions with Product with Serializable
Options for a streaming read of an input.
Options for a streaming read of an input.
- userOptions
Holds the user defined read options.
- droppedUserOptions
Holds the options that were specified by the user but not actually used. This is a bug but we are preserving this behavior for now to avoid making a backwards incompatible change.
Value Members
- object SchemaInferenceUtils
- object SchemaMergingUtils
- object SparkSessionUtils
- object StreamingReadOptions extends Serializable