Slow Training Speed Issue

[langy888]

Hi,

I have followed the steps provided in the repository to run the training for gluestick. However, I have noticed that the training speed is extremely slow. According to the paper, it took ten days to train on two 2080 GPUs. Currently, I'm using two 3090 GPUs, and one epoch takes more than 22 hours. Is this normal? If not, are there any suggestions or improvements that could help speed up the training process?

Thank you!

[rpautrat]

Hi, usually the extraction of the point and line features is what takes most of the time. So I would suggest either caching the features to avoid re-computing them each time, or try to parallelize more this step. GlueStick is indeed unfortunately quite slow to train, but we are working on a faster version now.