Migrating from Koalas to pandas API on Spark¶
The package name to import should be changed to
# import databricks.koalas as ks import pyspark.pandas as ps
DataFrame.koalasin Koalas DataFrame was renamed to
DataFrame.pandas_on_sparkin pandas-on-Spark DataFrame.
DataFrame.koalaswas kept for compatibility reason but deprecated as of Spark 3.2.
DataFrame.koalaswill be removed in the future releases.
DataFrame.to_koalasin PySpark DataFrame was renamed to
DataFrame.to_pandas_on_sparkin PySpark DataFrame.
DataFrame.to_koalaswas kept for compatibility reason but deprecated as of Spark 3.2.
DataFrame.to_koalaswill be removed in the future releases.
pyspark.__version__should be used instead.