Class GraphLoader

Object
org.apache.spark.graphx.GraphLoader

public class GraphLoader extends Object
Provides utilities for loading Graphs from files.
  • Constructor Details

    • GraphLoader

      public GraphLoader()
  • Method Details

    • edgeListFile

      public static Graph<Object,Object> edgeListFile(SparkContext sc, String path, boolean canonicalOrientation, int numEdgePartitions, StorageLevel edgeStorageLevel, StorageLevel vertexStorageLevel)
      Loads a graph from an edge list formatted file where each line contains two integers: a source id and a target id. Skips lines that begin with #.

      If desired the edges can be automatically oriented in the positive direction (source Id is less than target Id) by setting canonicalOrientation to true.

      Parameters:
      sc - SparkContext
      path - the path to the file (e.g., /home/data/file or hdfs://file)
      canonicalOrientation - whether to orient edges in the positive direction
      numEdgePartitions - the number of partitions for the edge RDD Setting this value to -1 will use the default parallelism.
      edgeStorageLevel - the desired storage level for the edge partitions
      vertexStorageLevel - the desired storage level for the vertex partitions
      Returns:
      (undocumented)
      Example:
      Loads a file in the following format:
      
       # Comment Line
       # Source Id <\t> Target Id
       1   -5
       1    2
       2    7
       1    8
       

    • org$apache$spark$internal$Logging$$log_

      public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()
    • org$apache$spark$internal$Logging$$log__$eq

      public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)
    • LogStringContext

      public static org.apache.spark.internal.Logging.LogStringContext LogStringContext(scala.StringContext sc)