Python Data Source#
Returns a string represents the format name of this data source. |
|
|
Returns a |
Returns the schema of the data source. |
|
|
Returns a |
|
Returns a |
Returns an iterator of partitions for this data source. |
|
|
Generates data for a given partition and returns an iterator of tuples or rows. |
|
Register a Python user-defined data source. |
Informs the source that Spark has completed processing all data for offsets less than or equal to end and will only request offsets greater than end in the future. |
|
Return the initial offset of the streaming data source. |
|
Returns the most recent offset available. |
|
|
Returns a list of InputPartition given the start and end offsets. |
|
Generates data for a given partition and returns an iterator of tuples or rows. |
Stop this source and free any resources it has allocated. |
|
|
Aborts this writing job due to task failures. |
|
Commits this writing job with a list of commit messages. |
|
Writes data into the data source. |