Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add EVM indexing using subsquid #1

Merged
merged 46 commits into from
Jul 30, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
82e4b6f
Add EVM indexing using subsquid
mj52951 Jul 4, 2024
3925669
Modify env variable name
mj52951 Jul 4, 2024
41f7f85
Modify logging
mj52951 Jul 4, 2024
cb81148
Add license
mj52951 Jul 5, 2024
563f420
Minor refactor changes
mj52951 Jul 5, 2024
fbaf4e2
Creating Substrate providers on init
mj52951 Jul 5, 2024
2d2e55e
Fix race condition
mj52951 Jul 5, 2024
bbad818
Added indexer in docker-compose
mj52951 Jul 8, 2024
dadc9cb
Remove redundant env vars
mj52951 Jul 8, 2024
853fee7
Added lint
mj52951 Jul 8, 2024
489db09
Add workflows
mj52951 Jul 8, 2024
8a52933
Remove code quality check temporarily
mj52951 Jul 8, 2024
a23468e
Created function for upserting transfers
mj52951 Jul 8, 2024
ee4fadd
Add config functions and validation
mj52951 Jul 10, 2024
a71e70f
Lint and log
mj52951 Jul 10, 2024
a4226d3
Refactor main and evmProcessor
mj52951 Jul 10, 2024
787ef50
Better error handling
mj52951 Jul 10, 2024
3b55c34
Push generated migrations
mj52951 Jul 10, 2024
7f288dc
Modify dockerignore
mj52951 Jul 10, 2024
507c5e1
Make gateway optional
mj52951 Jul 11, 2024
7dff1d4
Add unit testing
mj52951 Jul 11, 2024
301fbc7
Minor main refactor
mj52951 Jul 11, 2024
f1ae676
Use sygma-sdk types and contract service refactor
mj52951 Jul 11, 2024
5a8163e
Lint
mj52951 Jul 11, 2024
a15f5e7
Separate shared config from domain config
mj52951 Jul 12, 2024
9d72294
Move getContract to utils
mj52951 Jul 12, 2024
6e17b81
Move .env to envs dir
mj52951 Jul 12, 2024
dea4bc3
Fix domain naming
mj52951 Jul 12, 2024
cc73ae3
Better error handling
mj52951 Jul 15, 2024
31983e5
Add additional unit tests
mj52951 Jul 15, 2024
aba7523
Change getFee arg
mj52951 Jul 15, 2024
2841796
Remove unused dependencies
mj52951 Jul 16, 2024
60de16a
Batch processing
mj52951 Jul 16, 2024
b4c7261
Version updates and lint
mj52951 Jul 16, 2024
6083e87
.sh commands to package.json
mj52951 Jul 16, 2024
1777ea9
Using subarray
mj52951 Jul 16, 2024
f1ceb95
Modify tests
mj52951 Jul 16, 2024
adeba4d
Lower db requests
mj52951 Jul 18, 2024
64fd9d6
Containerization modifications
mj52951 Jul 22, 2024
3757021
Change lint config
mj52951 Jul 22, 2024
a0eb9d7
Remove unused dependency
mj52951 Jul 22, 2024
11b8322
Add polkadot resolutions
mj52951 Jul 22, 2024
39e9bfa
Minor changes
mj52951 Jul 22, 2024
7bf7748
Modify parseSubstrateDestination
mj52951 Jul 29, 2024
29d2302
Workflow and dockerfile changes
mj52951 Jul 29, 2024
67cc0fc
Change transfer ID creation
mj52951 Jul 29, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
node_modules
lib
Dockerfile
docker-compose.yml
.dockerignore
2 changes: 2 additions & 0 deletions .eslintignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
src/model/**
src/abi/**
6 changes: 6 additions & 0 deletions .eslintrc.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
module.exports = {
root: true,
extends: [
"@chainsafe"
]
}
31 changes: 31 additions & 0 deletions .github/workflows/ci.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,31 @@
name: 'Lint, Build, and Test'

on:
push:
branches:
- main
pull_request:
types: [opened, synchronize, reopened]

jobs:
check:
runs-on: ubuntu-latest
strategy:
matrix:
os: [ubuntu-latest]
node: [18]
fail-fast: true
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
cache: 'yarn' # cache node modules
node-version: ${{ matrix.node }}
- run: corepack enable
- run: yarn
mj52951 marked this conversation as resolved.
Show resolved Hide resolved
- run: yarn run lint
- name: Check license
run: yarn run license-check
- run: yarn run build
- name: Run tests
run: yarn run test:unit
19 changes: 19 additions & 0 deletions .github/workflows/pr.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
name: "Semantic PR"

on: [pull_request]

jobs:
main:
name: Validate PR title
runs-on: ubuntu-latest
steps:
- uses: amannn/action-semantic-pull-request@v4
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
types: |
fix
feat
chore
revert
requireScope: false
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
/node_modules
/lib

# IDE files
/.idea
pnpm-lock.yaml
**/*.log
7 changes: 7 additions & 0 deletions .squidignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
node_modules
builds
lib
Dockerfile
.git
.github
.idea
1 change: 1 addition & 0 deletions .yarnrc.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
nodeLinker: node-modules
44 changes: 44 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# The Licensed Work is (c) 2024 Sygma
# SPDX-License-Identifier: LGPL-3.0-only
FROM node:18-alpine AS builder

# update packages
RUN apk update

# install git
RUN apk add --no-cache git

# create root application folder
WORKDIR /squid

# enable corepack
RUN corepack enable

# copy configs to /squid folder
COPY .yarnrc.yml ./
COPY package*.json ./
COPY tsconfig.json ./
COPY yarn.lock ./

RUN corepack yarn install

# copy source code to /squid/src folder
COPY . .

RUN corepack yarn build

FROM node:18-alpine
COPY --from=builder /squid/node_modules ./node_modules
COPY --from=builder /squid/package*.json ./
COPY --from=builder /squid/lib ./lib
COPY --from=builder /squid/envs ./envs
COPY --from=builder /squid/db ./db
COPY --from=builder /squid/start-prod.sh ./start-prod.sh
COPY --from=builder /squid/commands.json ./

RUN corepack yarn global add @subsquid/commands && mv $(which squid-commands) /usr/local/bin/sqd

LABEL org.opencontainers.image.source https://github.com/sygmaprotocol/squid-indexer/
EXPOSE 8000

ENTRYPOINT sh /start-prod.sh
165 changes: 165 additions & 0 deletions LICENSE
Original file line number Diff line number Diff line change
@@ -0,0 +1,165 @@
GNU LESSER GENERAL PUBLIC LICENSE
Version 3, 29 June 2007

Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
Everyone is permitted to copy and distribute verbatim copies
of this license document, but changing it is not allowed.


This version of the GNU Lesser General Public License incorporates
the terms and conditions of version 3 of the GNU General Public
License, supplemented by the additional permissions listed below.

0. Additional Definitions.

As used herein, "this License" refers to version 3 of the GNU Lesser
General Public License, and the "GNU GPL" refers to version 3 of the GNU
General Public License.

"The Library" refers to a covered work governed by this License,
other than an Application or a Combined Work as defined below.

An "Application" is any work that makes use of an interface provided
by the Library, but which is not otherwise based on the Library.
Defining a subclass of a class defined by the Library is deemed a mode
of using an interface provided by the Library.

A "Combined Work" is a work produced by combining or linking an
Application with the Library. The particular version of the Library
with which the Combined Work was made is also called the "Linked
Version".

The "Minimal Corresponding Source" for a Combined Work means the
Corresponding Source for the Combined Work, excluding any source code
for portions of the Combined Work that, considered in isolation, are
based on the Application, and not on the Linked Version.

The "Corresponding Application Code" for a Combined Work means the
object code and/or source code for the Application, including any data
and utility programs needed for reproducing the Combined Work from the
Application, but excluding the System Libraries of the Combined Work.

1. Exception to Section 3 of the GNU GPL.

You may convey a covered work under sections 3 and 4 of this License
without being bound by section 3 of the GNU GPL.

2. Conveying Modified Versions.

If you modify a copy of the Library, and, in your modifications, a
facility refers to a function or data to be supplied by an Application
that uses the facility (other than as an argument passed when the
facility is invoked), then you may convey a copy of the modified
version:

a) under this License, provided that you make a good faith effort to
ensure that, in the event an Application does not supply the
function or data, the facility still operates, and performs
whatever part of its purpose remains meaningful, or

b) under the GNU GPL, with none of the additional permissions of
this License applicable to that copy.

3. Object Code Incorporating Material from Library Header Files.

The object code form of an Application may incorporate material from
a header file that is part of the Library. You may convey such object
code under terms of your choice, provided that, if the incorporated
material is not limited to numerical parameters, data structure
layouts and accessors, or small macros, inline functions and templates
(ten or fewer lines in length), you do both of the following:

a) Give prominent notice with each copy of the object code that the
Library is used in it and that the Library and its use are
covered by this License.

b) Accompany the object code with a copy of the GNU GPL and this license
document.

4. Combined Works.

You may convey a Combined Work under terms of your choice that,
taken together, effectively do not restrict modification of the
portions of the Library contained in the Combined Work and reverse
engineering for debugging such modifications, if you also do each of
the following:

a) Give prominent notice with each copy of the Combined Work that
the Library is used in it and that the Library and its use are
covered by this License.

b) Accompany the Combined Work with a copy of the GNU GPL and this license
document.

c) For a Combined Work that displays copyright notices during
execution, include the copyright notice for the Library among
these notices, as well as a reference directing the user to the
copies of the GNU GPL and this license document.

d) Do one of the following:

0) Convey the Minimal Corresponding Source under the terms of this
License, and the Corresponding Application Code in a form
suitable for, and under terms that permit, the user to
recombine or relink the Application with a modified version of
the Linked Version to produce a modified Combined Work, in the
manner specified by section 6 of the GNU GPL for conveying
Corresponding Source.

1) Use a suitable shared library mechanism for linking with the
Library. A suitable mechanism is one that (a) uses at run time
a copy of the Library already present on the user's computer
system, and (b) will operate properly with a modified version
of the Library that is interface-compatible with the Linked
Version.

e) Provide Installation Information, but only if you would otherwise
be required to provide such information under section 6 of the
GNU GPL, and only to the extent that such information is
necessary to install and execute a modified version of the
Combined Work produced by recombining or relinking the
Application with a modified version of the Linked Version. (If
you use option 4d0, the Installation Information must accompany
the Minimal Corresponding Source and Corresponding Application
Code. If you use option 4d1, you must provide the Installation
Information in the manner specified by section 6 of the GNU GPL
for conveying Corresponding Source.)

5. Combined Libraries.

You may place library facilities that are a work based on the
Library side by side in a single library together with other library
facilities that are not Applications and are not covered by this
License, and convey such a combined library under terms of your
choice, if you do both of the following:

a) Accompany the combined library with a copy of the same work based
on the Library, uncombined with any other library facilities,
conveyed under the terms of this License.

b) Give prominent notice with the combined library that part of it
is a work based on the Library, and explaining where to find the
accompanying uncombined form of the same work.

6. Revised Versions of the GNU Lesser General Public License.

The Free Software Foundation may publish revised and/or new versions
of the GNU Lesser General Public License from time to time. Such new
versions will be similar in spirit to the present version, but may
differ in detail to address new problems or concerns.

Each version is given a distinguishing version number. If the
Library as you received it specifies that a certain numbered version
of the GNU Lesser General Public License "or any later version"
applies to it, you have the option of following the terms and
conditions either of that published version or of any later version
published by the Free Software Foundation. If the Library as you
received it does not specify a version number of the GNU Lesser
General Public License, you may choose any version of the GNU Lesser
General Public License ever published by the Free Software Foundation.

If the Library as you received it specifies that a proxy can decide
whether future versions of the GNU Lesser General Public License shall
apply, that proxy's public statement of acceptance of any version is
permanent authorization for you to choose that version for the
Library.
19 changes: 18 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1 +1,18 @@
# squid-indexer
# Sygma Squid Indexer

### Running locally

Starting the indexer:

`yarn start`

Checking stored data using GraphQL:

`sqd serve`

Stopping and removing containers:

`yarn stop`

For additional commands see `commands.json`

Loading
Loading