public class PartitioningUtils
extends Object
Constructor and Description |
---|
PartitioningUtils() |
Modifier and Type | Method and Description |
---|---|
static org.apache.spark.sql.catalyst.expressions.Expression |
castPartitionSpec(String value,
DataType dt,
org.apache.spark.sql.internal.SQLConf conf) |
static <T> scala.collection.immutable.Map<String,T> |
normalizePartitionSpec(scala.collection.immutable.Map<String,T> partitionSpec,
StructType partCols,
String tblName,
scala.Function2<String,String,Object> resolver)
Normalize the column names in partition specification, w.r.t.
|
static void |
requireExactMatchedPartitionSpec(String tableName,
scala.collection.immutable.Map<String,String> spec,
scala.collection.Seq<String> partitionColumnNames)
Verify if the input partition spec exactly matches the existing defined partition spec
The columns must be the same but the orders could be different.
|
public static org.apache.spark.sql.catalyst.expressions.Expression castPartitionSpec(String value, DataType dt, org.apache.spark.sql.internal.SQLConf conf)
public static <T> scala.collection.immutable.Map<String,T> normalizePartitionSpec(scala.collection.immutable.Map<String,T> partitionSpec, StructType partCols, String tblName, scala.Function2<String,String,Object> resolver)
monTh
, and there is a
partition column named month
, and it's case insensitive, we will normalize monTh
to
month
.partitionSpec
- (undocumented)partCols
- (undocumented)tblName
- (undocumented)resolver
- (undocumented)public static void requireExactMatchedPartitionSpec(String tableName, scala.collection.immutable.Map<String,String> spec, scala.collection.Seq<String> partitionColumnNames)
tableName
- (undocumented)spec
- (undocumented)partitionColumnNames
- (undocumented)