public class OrcFileOperator
extends java.lang.Object
Constructor and Description |
---|
OrcFileOperator() |
Modifier and Type | Method and Description |
---|---|
static scala.Option<org.apache.hadoop.hive.ql.io.orc.Reader> |
getFileReader(java.lang.String basePath,
scala.Option<org.apache.hadoop.conf.Configuration> config)
Retrieves a ORC file reader from a given path.
|
static scala.Option<org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector> |
getObjectInspector(java.lang.String path,
scala.Option<org.apache.hadoop.conf.Configuration> conf) |
protected static void |
initializeLogIfNecessary(boolean isInterpreter) |
protected static boolean |
isTraceEnabled() |
static scala.collection.Seq<org.apache.hadoop.fs.Path> |
listOrcFiles(java.lang.String pathStr,
org.apache.hadoop.conf.Configuration conf) |
protected static org.slf4j.Logger |
log() |
protected static void |
logDebug(scala.Function0<java.lang.String> msg) |
protected static void |
logDebug(scala.Function0<java.lang.String> msg,
java.lang.Throwable throwable) |
protected static void |
logError(scala.Function0<java.lang.String> msg) |
protected static void |
logError(scala.Function0<java.lang.String> msg,
java.lang.Throwable throwable) |
protected static void |
logInfo(scala.Function0<java.lang.String> msg) |
protected static void |
logInfo(scala.Function0<java.lang.String> msg,
java.lang.Throwable throwable) |
protected static java.lang.String |
logName() |
protected static void |
logTrace(scala.Function0<java.lang.String> msg) |
protected static void |
logTrace(scala.Function0<java.lang.String> msg,
java.lang.Throwable throwable) |
protected static void |
logWarning(scala.Function0<java.lang.String> msg) |
protected static void |
logWarning(scala.Function0<java.lang.String> msg,
java.lang.Throwable throwable) |
static scala.Option<StructType> |
readSchema(scala.collection.Seq<java.lang.String> paths,
scala.Option<org.apache.hadoop.conf.Configuration> conf) |
public static scala.Option<org.apache.hadoop.hive.ql.io.orc.Reader> getFileReader(java.lang.String basePath, scala.Option<org.apache.hadoop.conf.Configuration> config)
The reader returned by this method is mainly used for two purposes:
1. Retrieving file metadata (schema and compression codecs, etc.) 2. Read the actual file content (in this case, the given path should point to the target file)
basePath
- (undocumented)config
- (undocumented)public static scala.Option<StructType> readSchema(scala.collection.Seq<java.lang.String> paths, scala.Option<org.apache.hadoop.conf.Configuration> conf)
public static scala.Option<org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector> getObjectInspector(java.lang.String path, scala.Option<org.apache.hadoop.conf.Configuration> conf)
public static scala.collection.Seq<org.apache.hadoop.fs.Path> listOrcFiles(java.lang.String pathStr, org.apache.hadoop.conf.Configuration conf)
protected static java.lang.String logName()
protected static org.slf4j.Logger log()
protected static void logInfo(scala.Function0<java.lang.String> msg)
protected static void logDebug(scala.Function0<java.lang.String> msg)
protected static void logTrace(scala.Function0<java.lang.String> msg)
protected static void logWarning(scala.Function0<java.lang.String> msg)
protected static void logError(scala.Function0<java.lang.String> msg)
protected static void logInfo(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void logDebug(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void logTrace(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void logWarning(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void logError(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static boolean isTraceEnabled()
protected static void initializeLogIfNecessary(boolean isInterpreter)