SparkSession.copyFromLocalToFs(local_path: str, dest_path: str) → None[source]

Copy file from local to cloud storage file system. If the file already exits in destination path, old file is overwritten.

New in version 3.5.0.

local_path: str

Path to a local file. Directories are not supported. The path can be either an absolute path or a relative path.

dest_path: str

The cloud storage path to the destination the file will be copied to. The path must be an an absolute path.


This API is a developer API. Also, this is an API dedicated to Spark Connect client only. With regular Spark Session, it throws an exception.