pyspark.sql.datasource.DataSourceWriter.abort#
- DataSourceWriter.abort(messages)[source]#
Aborts this writing job due to task failures.
This method is invoked on the driver when one or more tasks failed. The commit messages are collected from the
DataSourceWriter.write()method call from each task, and are passed to this method. The implementation should use the commit messages to abort the writing job to the data source.- Parameters
- messageslist of
WriterCommitMessages A list of commit messages. If a write task fails, the commit message will be None.
- messageslist of