portainer stuck in bootloop not sure how to fix

[alex-w-k]

Ask a Question!

i am not sure what happened but I came back to my portainer interface and it was not longer responding nor loading, i checked the logs and all i saw was loops of:

portainer_portainer.1.prt7gmsgkzec@docker-swarm-manager-3    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:369 > encryption key file not present | filename=portainer
portainer_portainer.1.prt7gmsgkzec@docker-swarm-manager-3    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:392 > proceeding without encryption key |
portainer_portainer.1.prt7gmsgkzec@docker-swarm-manager-3    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/database/boltdb/db.go:125 > loading PortainerDB | filename=portainer.db
portainer_portainer.1.prt7gmsgkzec@docker-swarm-manager-3    | 2024/06/20 11:20PM FTL github.com/portainer/portainer/api/cmd/portainer/main.go:98 > failed opening store | error="invalid database"
portainer_portainer.1.ppi6y5wu7fmc@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:369 > encryption key file not present | filename=portainer
portainer_portainer.1.ppi6y5wu7fmc@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:392 > proceeding without encryption key |
portainer_portainer.1.ppi6y5wu7fmc@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/database/boltdb/db.go:125 > loading PortainerDB | filename=portainer.db
portainer_portainer.1.plnwm7h5nu6o@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:369 > encryption key file not present | filename=portainer
portainer_portainer.1.plnwm7h5nu6o@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:392 > proceeding without encryption key |
portainer_portainer.1.plnwm7h5nu6o@docker-swarm-manager-1    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/database/boltdb/db.go:125 > loading PortainerDB | filename=portainer.db
portainer_portainer.1.ppi6y5wu7fmc@docker-swarm-manager-1    | 2024/06/20 11:20PM FTL github.com/portainer/portainer/api/cmd/portainer/main.go:98 > failed opening store | error="invalid database"
portainer_portainer.1.plnwm7h5nu6o@docker-swarm-manager-1    | 2024/06/20 11:20PM FTL github.com/portainer/portainer/api/cmd/portainer/main.go:98 > failed opening store | error="invalid database"
portainer_portainer.1.258skzjc0kbz@docker-swarm-manager-2    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:369 > encryption key file not present | filename=portainer
portainer_portainer.1.258skzjc0kbz@docker-swarm-manager-2    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/cmd/portainer/main.go:392 > proceeding without encryption key |
portainer_portainer.1.258skzjc0kbz@docker-swarm-manager-2    | 2024/06/20 11:20PM INF github.com/portainer/portainer/api/database/boltdb/db.go:125 > loading PortainerDB | filename=portainer.db
portainer_portainer.1.258skzjc0kbz@docker-swarm-manager-2    | 2024/06/20 11:20PM FTL github.com/portainer/portainer/api/cmd/portainer/main.go:98 > failed opening store | error="invalid database"

any ideas on how to resolve this issue?

[Nick-Portainer]

How did you deploy Portainer and what is the current health of your Swarm nodes?

[alex-w-k]

i deployed portainer using a modified stack file so i could have persistent storage through migrations, i have my volume mounted on a ceph drive locally rather than using a volume because when trying to use a volume i hit similar issues.

[Nick-Portainer]

Portainer does not play well with having it's Database on a network shares, it's suggeted to keep Portainer and it's volume on the same host/manager, and take backups as you would if you were running Standalone incase if the manager ever went down.