Gradoop HBase Store

Apache HBase Apache HBase™ is the Hadoop database, a distributed, scalable, big data store.

With this adapter implementation you can use Apache HBase as DataSource and DataSink for your graph data.

Getting start

Add gradoop-hbase to your dependency

Compile gradoop hbase with

mvn clean install -DskipTests=true

Copy gradoop-store/gradoop-hbase/target/gradoop-hbase-<ver>.jar into your client lib.

Or you can simply use maven pom as below:

<!-- Maven Gradoop HBase -->
<dependency>
    <groupId>org.gradoop</groupId>
    <artifactId>gradoop-hbase</artifactId>
    <version>${gradoop.version}</version>
</dependency>

Creation of an HBase based Graph-store

// create gradoop HBase configuration
GradoopHBaseConfig config = GradoopHBaseConfig.getDefaultConfig();

// create HBase configuration
HBaseConfiguration hbconfig = HBaseConfiguration.create();

// create store
HBaseEPGMStore graphStore = HBaseEPGMStoreFactory
    .createOrOpenEPGMStore(hbconfig, config);

Now let's add some graph elements

graphStore.writeGraphHead(graphHead);
graphStore.wirteVertex(vertex);
graphStore.writeEdge(edge);

graphStore.flush();

Accessing Data

Example for DataSink & DataSource

Read data from store

// data source
GradoopFlinkConfig flinkConfig = GradoopFlinkConfig
    .createConfig(getExecutionEnvironment());
DataSource hbaseDataSource = new HBaseDataSource(graphStore, flinkConfig);
GraphCollection result = HBaseDataSource.cypher(
    "MATCH (u1:Person)<-[:hasModerator]-(f:Forum)" +
    "(u2:Person)<-[:hasMember]-(f)" +
    "WHERE u1.name = \"Alice\"");

Write data to store

// data sink
GradoopFlinkConfig flinkConfig = GradoopFlinkConfig
    .createConfig(getExecutionEnvironment());
DataSink HBaseSink = new HBaseDataSink(graphStore, flinkConfig);
HBaseSink.write(result);

Store Layout

GraphData (table 'graph_heads')

----------*-------------*-----------------------*------------*-----------------------
  row     |     cf      |           cq          |  timestamp |   value
----------*-------------*-----------------------*------------*-----------------------
          |     m       |           l           |            |  {label}
  {id}    *-------------*-----------------------*------------*-----------------------
          |   p_type    |      {property key}   |            |  {property type byte}
          *-------------*-----------------------*------------*-----------------------
          |   p_value   |      {property key}   |            |  {property value}
----------*-------------*-----------------------*------------*-----------------------


VertexData (table 'vertices')

----------*-------------*-----------------------*------------*-----------------------
  row     |     cf      |           cq          |  timestamp |   value
----------*-------------*-----------------------*------------*-----------------------
          |      m      |            l          |            |  {label}
  {id}    *-------------*-----------------------*------------*-----------------------
          |      m      |            g          |            |  {graph id}
          *-------------*-----------------------*------------*-----------------------
          |   p_type    |      {property key}   |            |  {property type byte}
          *-------------*-----------------------*------------*-----------------------
          |   p_value   |      {property key}   |            |  {property value}
----------*-------------*-----------------------*------------*-----------------------

EdgeData (table 'edges')

----------*-------------*-----------------------*------------*-----------------------
  row     |     cf      |           cq          |  timestamp |   value
----------*-------------*-----------------------*------------*-----------------------
          |      m      |            l          |            |  {label}
          *-------------*-----------------------*------------*-----------------------
          |      m      |            g          |            |  {graph id}
  {id}    *-------------*-----------------------*------------*-----------------------
          |      m      |            s          |            |  {source vertex id}
          *-------------*-----------------------*------------*-----------------------
          |      m      |            t          |            |  {varget vertex id}
          *-------------*-----------------------*------------*-----------------------
          |   p_type    |      {property key}   |            |  {property type byte}
          *-------------*-----------------------*------------*-----------------------
          |   p_value   |      {property key}   |            |  {property value}
----------*-------------*-----------------------*------------*-----------------------