Skip to content
/ GlueStick Public

Joint Deep Matcher for Points and Lines ๐Ÿ–ผ๏ธ๐Ÿ’ฅ๐Ÿ–ผ๏ธ (ICCV 2023)

License

Notifications You must be signed in to change notification settings

cvg/GlueStick

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

24 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

GlueStick

Open in Colab arXiv Project Page

Joint deep matcher for points and lines ๐Ÿ–ผ๏ธ๐Ÿ’ฅ๐Ÿ–ผ๏ธ

Update: we are pleased to announce that the training code has been released within our new training framework, GlueFactory.

Visualization of point and line matches

This repository contains the official implementation of GlueStick: Robust Image Matching by Sticking Points and Lines Together, accepted at ICCV 2023.

Install ๐Ÿ› ๏ธ

To install the software in Ubuntu 22.04 follow these instructions:

sudo apt-get install build-essential cmake libopencv-dev libopencv-contrib-dev
git clone --recursive https://github.com/cvg/GlueStick.git
cd GlueStick
# Create and activate a virtual environment
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
pip install .

Running GlueStick ๐Ÿƒ

Download the weights of the model:

wget https://github.com/cvg/GlueStick/releases/download/v0.1_arxiv/checkpoint_GlueStick_MD.tar -P resources/weights

You can execute the inference with it with:

python -m gluestick.run -img1 resources/img1.jpg -img2 resources/img2.jpg

Training ๐Ÿ‹๏ธ

The training code is available in a separate repository, GlueFactory. Within GlueFactory, you can not only train GlueStick, but also other deep matchers such as LightGlue, use multiple feature extractors, line extractors, robust estimators, as well as run evaluations on multiple benchmarks.

Licence ๐Ÿ“œ

Our code is licenced under MIT licence. However, bear in mind that it uses a SuperPoint backbone that has a non-commercial licence. Therefore, the overall system is non-commercial ๐Ÿ˜ž. We are working on an analogous version based on DISK to avoid this problem.

Citation ๐Ÿ“

If you use this code in your project, please consider citing the following paper:

@InProceedings{pautrat_suarez_2023_gluestick,
    title={{GlueStick}: Robust Image Matching by Sticking Points and Lines Together},
    author={Pautrat, R{\'e}mi* and Su{\'a}rez, Iago* and Yu, Yifan and Pollefeys, Marc and Larsson, Viktor},
    booktitle={International Conference on Computer Vision (ICCV)},
    year={2023}
}