Package org.apache.spark.graphx

Class GraphLoader

Object

org.apache.spark.graphx.GraphLoader

public class GraphLoader
extends Object

Provides utilities for loading Graphs from files.

Constructor Summary

Constructors

Constructor	Description
GraphLoader()

Method Summary

Modifier and Type	Method	Description
static Graph<Object,Object>	edgeListFile(SparkContext sc, String path, boolean canonicalOrientation, int numEdgePartitions, StorageLevel edgeStorageLevel, StorageLevel vertexStorageLevel)	Loads a graph from an edge list formatted file where each line contains two integers: a source id and a target id.
static org.apache.spark.internal.Logging.LogStringContext	LogStringContext(scala.StringContext sc)
static org.slf4j.Logger	org$apache$spark$internal$Logging$$log_()
static void	org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GraphLoader

public GraphLoader()

Method Details

edgeListFile

public static Graph<Object,Object> edgeListFile(SparkContext sc,
 String path,
 boolean canonicalOrientation,
 int numEdgePartitions,
 StorageLevel edgeStorageLevel,
 StorageLevel vertexStorageLevel)

Loads a graph from an edge list formatted file where each line contains two integers: a source id and a target id. Skips lines that begin with #.

If desired the edges can be automatically oriented in the positive direction (source Id is less than target Id) by setting canonicalOrientation to true.

Parameters:

sc - SparkContext

path - the path to the file (e.g., /home/data/file or hdfs://file)

canonicalOrientation - whether to orient edges in the positive direction

numEdgePartitions - the number of partitions for the edge RDD Setting this value to -1 will use the default parallelism.

edgeStorageLevel - the desired storage level for the edge partitions

vertexStorageLevel - the desired storage level for the vertex partitions

Returns:

(undocumented)

Example:

Loads a file in the following format:

 # Comment Line
 # Source Id <\t> Target Id
 1   -5
 1    2
 2    7
 1    8
 

org$apache$spark$internal$Logging$$log_

public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()

org$apache$spark$internal$Logging$$log__$eq

public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)

LogStringContext

public static org.apache.spark.internal.Logging.LogStringContext LogStringContext(scala.StringContext sc)