Loader

Loader documentation

Loader is responsible for processing the data from MOD(s) into Neo4j database.

These steps assume you're on a Mac that has Docker installed.

Steps(required)

1. The loader initiates Neo4j and elastic search docker images when you run the command

   • $ make start_agr_box

2. To run the python module that loads the data, make sure you're running the script in a virtual enviroment to avoid messing up your global environment.

3. export the following variables into your virtualenv

   • TEST_SET=True #set to false if you don't want to run test data
   • NEO4J_NQC_HOST=localhost
   • NEO4J_NQC_PORT=7687

   i.e $ export TEST_SET=TRUE

4. After above is set run $ make run_agr_box_fetch command

5. If everything was set correctly, Loader will send the data to your running Neo4j database instance. You can check in your browser http://localhost:7474

Docker issues:

• Make sure your docker is allocated up to at least 6GB-8GB RAM otherwise you might have trouble running elastic-search and Neo4j images.
• If you have elastic search running locally, installed threw homebrew for instance, make sure you stop that services otherwise it will conflict with docker elastic search image. If not set appropriate ports to avoid conflicts.