Packages

c

org.apache.spark.udf.worker

WorkerCapabilities

final class WorkerCapabilities extends GeneratedMessage with WorkerCapabilitiesOrBuilder

Capabilities used for query planning
and running the worker during query execution.

Protobuf type org.apache.spark.udf.worker.WorkerCapabilities

Annotations
@Generated()
Source
WorkerCapabilities.java
Linear Supertypes
WorkerCapabilitiesOrBuilder, GeneratedMessage, Serializable, AbstractMessage, Message, MessageOrBuilder, AbstractMessageLite[MessageType, BuilderType], MessageLite, MessageLiteOrBuilder, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. WorkerCapabilities
  2. WorkerCapabilitiesOrBuilder
  3. GeneratedMessage
  4. Serializable
  5. AbstractMessage
  6. Message
  7. MessageOrBuilder
  8. AbstractMessageLite
  9. MessageLite
  10. MessageLiteOrBuilder
  11. AnyRef
  12. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(obj: AnyRef): Boolean
    Definition Classes
    WorkerCapabilities → AbstractMessage → Message → AnyRef → Any
    Annotations
    @Override()
  8. def findInitializationErrors(): List[String]
    Definition Classes
    AbstractMessage → MessageOrBuilder
  9. def getAllFields(): Map[FieldDescriptor, AnyRef]
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  11. def getDefaultInstanceForType(): WorkerCapabilities
    Definition Classes
    WorkerCapabilities → MessageOrBuilder → MessageLiteOrBuilder
    Annotations
    @Override()
  12. def getDescriptorForType(): Descriptor
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  13. def getField(field: FieldDescriptor): AnyRef
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  14. def getInitializationErrorString(): String
    Definition Classes
    AbstractMessage → MessageOrBuilder
  15. def getOneofFieldDescriptor(oneof: OneofDescriptor): FieldDescriptor
    Definition Classes
    GeneratedMessage → AbstractMessage → MessageOrBuilder
  16. def getParserForType(): Parser[WorkerCapabilities]
    Definition Classes
    WorkerCapabilities → GeneratedMessage → Message → MessageLite
    Annotations
    @Override()
  17. def getRepeatedField(field: FieldDescriptor, index: Int): AnyRef
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  18. def getRepeatedFieldCount(field: FieldDescriptor): Int
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  19. def getSerializedSize(): Int
    Definition Classes
    WorkerCapabilities → GeneratedMessage → AbstractMessage → MessageLite
    Annotations
    @Override()
  20. def getSupportedCommunicationPatterns(index: Int): UDFProtoCommunicationPattern

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFProtoCommunicationPattern supported_communication_patterns = 2;

    index

    The index of the element to return.

    returns

    The supportedCommunicationPatterns at the given index.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  21. def getSupportedCommunicationPatternsCount(): Int

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFProtoCommunicationPattern supported_communication_patterns = 2;

    returns

    The count of supportedCommunicationPatterns.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  22. def getSupportedCommunicationPatternsList(): List[UDFProtoCommunicationPattern]

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFProtoCommunicationPattern supported_communication_patterns = 2;

    returns

    A list containing the supportedCommunicationPatterns.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  23. def getSupportedCommunicationPatternsValue(index: Int): Int

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFProtoCommunicationPattern supported_communication_patterns = 2;

    index

    The index of the value to return.

    returns

    The enum numeric value on the wire of supportedCommunicationPatterns at the given index.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  24. def getSupportedCommunicationPatternsValueList(): List[Integer]

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    Which UDF protocol communication patterns the worker
    supports. This should list all supported patterns.
    The pattern used for a specific UDF will be communicated
    in the initial message of the UDF protocol.
    
    If an execution for an unsupported pattern is requested
    the query will fail during query planning.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFProtoCommunicationPattern supported_communication_patterns = 2;

    returns

    A list containing the enum numeric values on the wire for supportedCommunicationPatterns.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  25. def getSupportedDataFormats(index: Int): UDFWorkerDataFormat

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFWorkerDataFormat supported_data_formats = 1;

    index

    The index of the element to return.

    returns

    The supportedDataFormats at the given index.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  26. def getSupportedDataFormatsCount(): Int

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFWorkerDataFormat supported_data_formats = 1;

    returns

    The count of supportedDataFormats.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  27. def getSupportedDataFormatsList(): List[UDFWorkerDataFormat]

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFWorkerDataFormat supported_data_formats = 1;

    returns

    A list containing the supportedDataFormats.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  28. def getSupportedDataFormatsValue(index: Int): Int

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFWorkerDataFormat supported_data_formats = 1;

    index

    The index of the value to return.

    returns

    The enum numeric value on the wire of supportedDataFormats at the given index.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  29. def getSupportedDataFormatsValueList(): List[Integer]

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    The data formats that the worker supports for UDF data in- & output.
    Every worker MUST at least support ARROW.
    
    It is expected that for each UDF execution, the input format
    always matches the output format.
    
    If a worker supports multiple data formats, the engine will select
    the most suitable one for each UDF invocation. Which format was chosen
    is reported by the engine as part of the UDF protocol's init message.
    
    (Required)
    

    repeated .org.apache.spark.udf.worker.UDFWorkerDataFormat supported_data_formats = 1;

    returns

    A list containing the enum numeric values on the wire for supportedDataFormats.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  30. def getSupportsConcurrentUdfs(): Boolean

    Whether multiple, concurrent UDF
    connections are supported by this worker
    (for example via multi-threading).
    
    In the first implementation of the engine-side
    worker specification, this property will not be used.
    
    Usage of this property can be enabled in the future if the
    engine implements more advanced resource management (TBD).
    
    (Optional)
    

    Whether multiple, concurrent UDF
    connections are supported by this worker
    (for example via multi-threading).
    
    In the first implementation of the engine-side
    worker specification, this property will not be used.
    
    Usage of this property can be enabled in the future if the
    engine implements more advanced resource management (TBD).
    
    (Optional)
    

    optional bool supports_concurrent_udfs = 3;

    returns

    The supportsConcurrentUdfs.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  31. def getSupportsReuse(): Boolean

    Whether compatible workers may be reused.
    If this is not supported, the worker is
    terminated after every single UDF invocation.
    
    (Optional)
    

    Whether compatible workers may be reused.
    If this is not supported, the worker is
    terminated after every single UDF invocation.
    
    (Optional)
    

    optional bool supports_reuse = 4;

    returns

    The supportsReuse.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  32. def getUnknownFields(): UnknownFieldSet
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  33. def hasField(field: FieldDescriptor): Boolean
    Definition Classes
    GeneratedMessage → MessageOrBuilder
  34. def hasOneof(oneof: OneofDescriptor): Boolean
    Definition Classes
    GeneratedMessage → AbstractMessage → MessageOrBuilder
  35. def hasSupportsConcurrentUdfs(): Boolean

    Whether multiple, concurrent UDF
    connections are supported by this worker
    (for example via multi-threading).
    
    In the first implementation of the engine-side
    worker specification, this property will not be used.
    
    Usage of this property can be enabled in the future if the
    engine implements more advanced resource management (TBD).
    
    (Optional)
    

    Whether multiple, concurrent UDF
    connections are supported by this worker
    (for example via multi-threading).
    
    In the first implementation of the engine-side
    worker specification, this property will not be used.
    
    Usage of this property can be enabled in the future if the
    engine implements more advanced resource management (TBD).
    
    (Optional)
    

    optional bool supports_concurrent_udfs = 3;

    returns

    Whether the supportsConcurrentUdfs field is set.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  36. def hasSupportsReuse(): Boolean

    Whether compatible workers may be reused.
    If this is not supported, the worker is
    terminated after every single UDF invocation.
    
    (Optional)
    

    Whether compatible workers may be reused.
    If this is not supported, the worker is
    terminated after every single UDF invocation.
    
    (Optional)
    

    optional bool supports_reuse = 4;

    returns

    Whether the supportsReuse field is set.

    Definition Classes
    WorkerCapabilitiesWorkerCapabilitiesOrBuilder
    Annotations
    @Override()
  37. def hashCode(): Int
    Definition Classes
    WorkerCapabilities → AbstractMessage → Message → AnyRef → Any
    Annotations
    @Override()
  38. def internalGetFieldAccessorTable(): FieldAccessorTable
    Attributes
    protected[worker]
    Definition Classes
    WorkerCapabilities → GeneratedMessage
    Annotations
    @Override()
  39. def internalGetMapFieldReflection(fieldNumber: Int): MapFieldReflectionAccessor
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
  40. final def isInitialized(): Boolean
    Definition Classes
    WorkerCapabilities → GeneratedMessage → AbstractMessage → MessageLiteOrBuilder
    Annotations
    @Override()
  41. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  42. def makeExtensionsImmutable(): Unit
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
  43. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  44. def newBuilderForType(parent: BuilderParent): Builder
    Attributes
    protected[worker]
    Definition Classes
    WorkerCapabilities → AbstractMessage
    Annotations
    @Override()
  45. def newBuilderForType(): Builder
    Definition Classes
    WorkerCapabilities → Message → MessageLite
    Annotations
    @Override()
  46. def newInstance(unused: UnusedPrivateParameter): AnyRef
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
  47. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  48. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  49. def parseUnknownField(input: CodedInputStream, unknownFields: Builder, extensionRegistry: ExtensionRegistryLite, tag: Int): Boolean
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
    Annotations
    @throws(classOf[java.io.IOException])
  50. def parseUnknownFieldProto3(input: CodedInputStream, unknownFields: Builder, extensionRegistry: ExtensionRegistryLite, tag: Int): Boolean
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
    Annotations
    @throws(classOf[java.io.IOException])
  51. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  52. def toBuilder(): Builder
    Definition Classes
    WorkerCapabilities → Message → MessageLite
    Annotations
    @Override()
  53. def toByteArray(): Array[Byte]
    Definition Classes
    AbstractMessageLite → MessageLite
  54. def toByteString(): ByteString
    Definition Classes
    AbstractMessageLite → MessageLite
  55. final def toString(): String
    Definition Classes
    AbstractMessage → Message → AnyRef → Any
  56. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  57. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  58. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  59. def writeDelimitedTo(output: OutputStream): Unit
    Definition Classes
    AbstractMessageLite → MessageLite
    Annotations
    @throws(classOf[java.io.IOException])
  60. def writeReplace(): AnyRef
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
    Annotations
    @throws(classOf[java.io.ObjectStreamException])
  61. def writeTo(output: CodedOutputStream): Unit
    Definition Classes
    WorkerCapabilities → GeneratedMessage → AbstractMessage → MessageLite
    Annotations
    @Override()
  62. def writeTo(output: OutputStream): Unit
    Definition Classes
    AbstractMessageLite → MessageLite
    Annotations
    @throws(classOf[java.io.IOException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

  2. def internalGetMapField(fieldNumber: Int): MapField[_ <: AnyRef, _ <: AnyRef]
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
    Annotations
    @Deprecated
    Deprecated
  3. def mergeFromAndMakeImmutableInternal(input: CodedInputStream, extensionRegistry: ExtensionRegistryLite): Unit
    Attributes
    protected[protobuf]
    Definition Classes
    GeneratedMessage
    Annotations
    @throws(classOf[com.google.protobuf.InvalidProtocolBufferException]) @Deprecated
    Deprecated

Inherited from GeneratedMessage

Inherited from Serializable

Inherited from AbstractMessage

Inherited from Message

Inherited from MessageOrBuilder

Inherited from AbstractMessageLite[MessageType, BuilderType]

Inherited from MessageLite

Inherited from MessageLiteOrBuilder

Inherited from AnyRef

Inherited from Any

Ungrouped