Help Needed: Issues with Loading Data into Edges in OrientDB ETL Process

[MateusMelloSouza]

Hi everyone,

I'm currently working on an ETL process using OrientDB, and I'm encountering an issue when trying to load data into an edge after successfully inserting data into the vertexes. Specifically, I'm working with two types of vertexes: Person and Company.

My goal is to create an edge (Company-Person) that connects these two vertexes based on certain fields. The problem I'm facing is that while the data seems to be extracted correctly, it is not being loaded into the edge as expected. Additionally, I’m having trouble pinpointing where the problem occurs in the process, even after adjusting the log configuration to debug mode.

Environment Specs:

OrientDB Version: 3.2.27
Operating System: Amazon Linux 2
Deployment: EC2 instance

Here is an example of the JSON configuration I’m using:

{
  "config": {
    "log": "debug"
  },
  "source": {
    "file": {
      "path": "sample.csv",
      "lock": true
    }
  },
  "extractor": {
    "csv": {
      "separator": ",",
      "nullValue": "",
      "columns": [
        "_id:string",
        "_key:string",
        "cnpj:string",
        "cpf:string",
        "label:string",
        "isActive:string",
        "name:string"
      ]
    }
  },
  "transformers": [
    {
      "merge": {
        "joinFieldName": "cpf",
        "lookup": "person._id"
      }
    },
    {
      "edge": {
        "joinFieldName": "cnpj",
        "direction": "out",
        "class": "company_person",
        "lookup": "company._id",
        "unresolvedLinkAction": "CREATE"
      }
    }
  ],
  "loader": {
    "orientdb": {
      "dbURL": "remote:IP/TesteETL",
      "dbType": "graph",
      "dbUser": "root",
      "dbPassword": "root",
      "serverUser": "root",
      "serverPassword": "root",
      "dbAutoCreate": false
    }
  }
}

Here is a example of the CSV file:

_id,_key,cnpj,cpf,label,isActive,name
01,01,company_001_id_,person_001_id_,rdm_label,N,rdm_name

Despite following the above process, the edge does not appear to be created in the database. The ETL logs show that data extraction happens, but there’s no clear indication of why the edge is not being loaded.

I've already tried enabling detailed logging, but the output still doesn't give me a clear indication of the root cause. Does anyone have any experience with similar issues or suggestions on how to troubleshoot this further?

Any help would be greatly appreciated!

Thanks in advance!