Skip to content

InfuseAI/git-repo-analytics

Repository files navigation

Introduction

This is a demo project for PipeRider. It shows how you can use dbt+duckdb+PipeRider to transform and query data efficiently. With these tools, you can generate a report that gives you insights into your git projects.

Usage

  1. Clone this repo

    git clone [email protected]:InfuseAI/git-repo-analytics.git   
    
  2. Prepare git repositories repo for analysis by editing the repos.csv

    The format of the repos.csv file is as follows:

    name,repo
    dbt-core,dbt-labs/dbt-core
    duckdb,duckdb/duckdb
    PipeRider,InfuseAI/piperider
    
  3. Install python package

    python -m venv ./venv
    source ./venv/bin/activate
    pip install -r requirements.txt     
    
  4. Generate the db file from the repo.

    make fetch
    make load
    

    The file git_repo.duckdb is generated under ./data

  5. Run dbt

    make transform
    
  6. Generate report

    make report
    
  7. Run piperider

    make piperider
    

You can either run step-by-step from step4 to step7 or simply do one command

make

Screenshots

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published