Rocket.Chat not reachable (SNAP) after ServerBackup-Restore, MongoDb missing?!

Description

Hi,

I’d need some help and valuable hints from the community.

I am running self-hosted rocket.chat community-Version (via SNAP) on UBUNTU 18.04.5 LTS 4.15.0-118-generic x86_64 for over a year now. Hosting on a Cloud-Server at HETZNER. No problems till yesterday.

Background: I had some configuration-issues in the admin-panel and wasn’t able to handle them. So I decided quickly to roll back to the 2-hours -ld backup, which I have done a couple of months ago the first time without any problmes. So I thought that this won’t be a bid deal.

Wrong.

Now, the rocket.chat-server isn’t reachable via https or http.

What can be done?

I hope that you can feed me with some good advices to fix this.

Thanks in advance/best!

pinzo

Server Setup Information

  • Version of Rocket.Chat Server:
  • Operating System: UBUNTU 18.04.5 LTS 4.15.0-118-generic x86_64
  • Deployment Method: SNAP
  • Number of Running Instances: 1
  • DB Replicaset Oplog: (?)
  • NodeJS Version: v10.22.1
  • MongoDB Version: v3.6.3 (?)
  • Proxy:
  • Firewalls involved:

Any additional Information

I’ve checked the status via sudo systemctl status snap.rocketchat-server.rocketchat-server.service

snap.rocketchat-server.rocketchat-server.service - Service for snap application rocketchat-server.rocketchat-server

Loaded: loaded (/etc/systemd/system/snap.rocketchat-server.rocketchat-server.service; enabled; vendor preset: enabled)

Active: active (running) since Thu 2021-04-08 17:18:04 CEST; 1min 17s ago

Main PID: 29609 (startRocketChat)

Tasks: 2 (limit: 2298)

CGroup: /system.slice/snap.rocketchat-server.rocketchat-server.service

├─29609 /bin/bash /snap/rocketchat-server/1457/bin/startRocketChat

└─29705 sleep 30

Apr 08 17:18:04 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-server.

Apr 08 17:18:05 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 10 seconds and trying again

Apr 08 17:18:15 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 15 seconds and trying again

Apr 08 17:18:30 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 20 seconds and trying again

Apr 08 17:18:50 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 25 seconds and trying again

Apr 08 17:19:15 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 30 seconds and trying again

I’ve checked the status of MONGODB Service via sudo systemctl status snap.rocketchat-server.rocketchat-mongo.service

snap.rocketchat-server.rocketchat-mongo.service - Service for snap application rocketchat-server.rocketchat-mongo

Loaded: loaded (/etc/systemd/system/snap.rocketchat-server.rocketchat-mongo.service; enabled; vendor preset: enabled)

Active: failed (Result: exit-code) since Thu 2021-04-08 10:41:08 CEST; 6h ago

Main PID: 2322 (code=exited, status=48)

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Main process exited, code=exited, status=48/n/a

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Service hold-off time over, scheduling restart.

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Scheduled restart job, restart counter is at 6.

Apr 08 10:41:08 izhrocketchat systemd[1]: Stopped Service for snap application rocketchat-server.rocketchat-mongo.

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Start request repeated too quickly.

Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.

Apr 08 10:41:08 izhrocketchat systemd[1]: Failed to start Service for snap application rocketchat-server.rocketchat-mongo.

MONGODB seems to be the issue.

Rocket.Chat LOGS (excerpt)

Apr 08 10:40:52 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-server.

Apr 08 10:41:01 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 10 seconds and trying again

Apr 08 10:41:11 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 15 seconds and trying again

Apr 08 10:41:27 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 20 seconds and trying again

Apr 08 10:41:47 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 25 seconds and trying again

Apr 08 10:42:12 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 30 seconds and trying again

Apr 08 10:42:42 izhrocketchat rocketchat-server.rocketchat-server[1141]: Was unable to connect to Mongo. Please make sure Mongo has started successfully: sudo systemctl

Apr 08 10:42:42 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-server.service: Main process exited, code=exited, status=1/FAILURE

Apr 08 10:42:42 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-server.service: Failed with result ‘exit-code’.

Mongo LOGS

Apr 08 10:40:52 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-mongo.

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.959+0200 I CONTROL [initandlisten] MongoDB starting : pid=1471 port=27017 dbpath=/var/snap/rock

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.960+0200 I CONTROL [initandlisten] db version v3.6.14

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] git version: cbef87692475857c7ee6e764c8f5104b39c342a1

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] allocator: tcmalloc

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] modules: none

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] build environment:

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] distarch: x86_64

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] target_arch: x86_64

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 I CONTROL [initandlisten] options: { net: { bindIp: “127.0.0.1” }, processManagement:

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 W - [initandlisten] Detected unclean shutdown - /var/snap/rocketchat-server/comm

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 E STORAGE [initandlisten] Failed to set up listener: SocketException: Address already

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.967+0200 I CONTROL [initandlisten] now exiting

Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.973+0200 I CONTROL [initandlisten] shutting down with code:48

Apr 08 10:41:04 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Main process exited, code=exited, status=48/n/a

Apr 08 10:41:04 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.

This might probably be probably caused by a 2nd instance of MongoDB running? But really wasn’t able to solve this.