Description
Hi,
I’d need some help and valuable hints from the community.
I am running self-hosted rocket.chat community-Version (via SNAP) on UBUNTU 18.04.5 LTS 4.15.0-118-generic x86_64 for over a year now. Hosting on a Cloud-Server at HETZNER. No problems till yesterday.
Background: I had some configuration-issues in the admin-panel and wasn’t able to handle them. So I decided quickly to roll back to the 2-hours -ld backup, which I have done a couple of months ago the first time without any problmes. So I thought that this won’t be a bid deal.
Wrong.
Now, the rocket.chat-server isn’t reachable via https or http.
What can be done?
I hope that you can feed me with some good advices to fix this.
Thanks in advance/best!
pinzo
Server Setup Information
- Version of Rocket.Chat Server:
- Operating System: UBUNTU 18.04.5 LTS 4.15.0-118-generic x86_64
- Deployment Method: SNAP
- Number of Running Instances: 1
- DB Replicaset Oplog: (?)
- NodeJS Version: v10.22.1
- MongoDB Version: v3.6.3 (?)
- Proxy:
- Firewalls involved:
Any additional Information
I’ve checked the status via sudo systemctl status snap.rocketchat-server.rocketchat-server.service
● snap.rocketchat-server.rocketchat-server.service - Service for snap application rocketchat-server.rocketchat-server
Loaded: loaded (/etc/systemd/system/snap.rocketchat-server.rocketchat-server.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2021-04-08 17:18:04 CEST; 1min 17s ago
Main PID: 29609 (startRocketChat)
Tasks: 2 (limit: 2298)
CGroup: /system.slice/snap.rocketchat-server.rocketchat-server.service
├─29609 /bin/bash /snap/rocketchat-server/1457/bin/startRocketChat
└─29705 sleep 30
Apr 08 17:18:04 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-server.
Apr 08 17:18:05 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 10 seconds and trying again
Apr 08 17:18:15 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 15 seconds and trying again
Apr 08 17:18:30 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 20 seconds and trying again
Apr 08 17:18:50 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 25 seconds and trying again
Apr 08 17:19:15 izhrocketchat rocketchat-server.rocketchat-server[29609]: Mongo is not available, can’t start. Waiting 30 seconds and trying again
I’ve checked the status of MONGODB Service via sudo systemctl status snap.rocketchat-server.rocketchat-mongo.service
● snap.rocketchat-server.rocketchat-mongo.service - Service for snap application rocketchat-server.rocketchat-mongo
Loaded: loaded (/etc/systemd/system/snap.rocketchat-server.rocketchat-mongo.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Thu 2021-04-08 10:41:08 CEST; 6h ago
Main PID: 2322 (code=exited, status=48)
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Main process exited, code=exited, status=48/n/a
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Service hold-off time over, scheduling restart.
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Scheduled restart job, restart counter is at 6.
Apr 08 10:41:08 izhrocketchat systemd[1]: Stopped Service for snap application rocketchat-server.rocketchat-mongo.
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Start request repeated too quickly.
Apr 08 10:41:08 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.
Apr 08 10:41:08 izhrocketchat systemd[1]: Failed to start Service for snap application rocketchat-server.rocketchat-mongo.
MONGODB seems to be the issue.
Rocket.Chat LOGS (excerpt)
Apr 08 10:40:52 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-server.
Apr 08 10:41:01 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 10 seconds and trying again
Apr 08 10:41:11 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 15 seconds and trying again
Apr 08 10:41:27 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 20 seconds and trying again
Apr 08 10:41:47 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 25 seconds and trying again
Apr 08 10:42:12 izhrocketchat rocketchat-server.rocketchat-server[1141]: Mongo is not available, can’t start. Waiting 30 seconds and trying again
Apr 08 10:42:42 izhrocketchat rocketchat-server.rocketchat-server[1141]: Was unable to connect to Mongo. Please make sure Mongo has started successfully: sudo systemctl
Apr 08 10:42:42 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-server.service: Main process exited, code=exited, status=1/FAILURE
Apr 08 10:42:42 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-server.service: Failed with result ‘exit-code’.
Mongo LOGS
Apr 08 10:40:52 izhrocketchat systemd[1]: Started Service for snap application rocketchat-server.rocketchat-mongo.
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.959+0200 I CONTROL [initandlisten] MongoDB starting : pid=1471 port=27017 dbpath=/var/snap/rock
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.960+0200 I CONTROL [initandlisten] db version v3.6.14
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] git version: cbef87692475857c7ee6e764c8f5104b39c342a1
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] allocator: tcmalloc
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] modules: none
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] build environment:
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] distarch: x86_64
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.964+0200 I CONTROL [initandlisten] target_arch: x86_64
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 I CONTROL [initandlisten] options: { net: { bindIp: “127.0.0.1” }, processManagement:
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 W - [initandlisten] Detected unclean shutdown - /var/snap/rocketchat-server/comm
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.965+0200 E STORAGE [initandlisten] Failed to set up listener: SocketException: Address already
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.967+0200 I CONTROL [initandlisten] now exiting
Apr 08 10:41:04 izhrocketchat rocketchat-server.rocketchat-mongo[1176]: 2021-04-08T10:41:04.973+0200 I CONTROL [initandlisten] shutting down with code:48
Apr 08 10:41:04 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Main process exited, code=exited, status=48/n/a
Apr 08 10:41:04 izhrocketchat systemd[1]: snap.rocketchat-server.rocketchat-mongo.service: Failed with result ‘exit-code’.
This might probably be probably caused by a 2nd instance of MongoDB running? But really wasn’t able to solve this.