grzebo
April 20, 2024, 1:13am
1
Do you know if the “filestore-migrator” tool is working now?
I’m using filesystem storage for the uploaded files, but would like to move to an S3 storage.
I was very happy when I found the filestor-migrator tool, that could do that, but now I’m worried since there’s a bug report there, which claims that the cloud storage support is broken in that tool:
opened 08:46PM - 13 Oct 23 UTC
Dear all, when trying to migrate AmazonS3 source data to GoogleStorage.
It is… showing the following error.
```
2023/10/13 17:18:25 [10/13/2023 17:18:25] Source store type set to: AmazonS3
2023/10/13 17:18:25 [10/13/2023 17:18:25] Destination store type set to: GoogleStorage
2023/10/13 17:18:25 Beginning migration of files
2023/10/13 17:18:25 [10/13/2023 17:18:25] Store: Uploads
2023/10/13 17:18:26 [10/13/2023 17:18:26] uniqueId {uniqueID xxxxxxxxxxxxxxxxxxxxx}
2023/10/13 17:18:26 [10/13/2023 17:18:26] rocketchat_uploads AmazonS3:Uploads
2023/10/13 17:18:45 [10/13/2023 17:18:45] Found 183441 files
2023/10/13 17:18:45 [10/13/2023 17:18:45] [1/183441] Downloading Clipboard - 20 de Outubro de 2020 às 12:32 from: AmazonS3
2023/10/13 17:18:45 [10/13/2023 17:18:45] [1/183441] Uploading to GoogleCloudStorage to: xxxxxxxxxxxxxxx/uploads/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
panic: write exception: write errors: [Updating the path 'AmazonS3' would create a conflict at 'AmazonS3']
```
Below is the configuration file used
Follow command
```sh
filestore-migrator -action migrate -config config.yaml -verbose true
```
Has anyone used it recently to migrate to S3 storage?
Or maybe you know some other way to do that?
reetp
April 22, 2024, 8:59am
2
This thread has someone using it.
https://open.rocket.chat/channel/support?msg=z9EQzGotPqutwoXNm
I would seriously suggest you do some testing on a test installation first, and make sure you have a lot of backups.
Try moving files from GridFS to local storage first, and after try a bucket.
You can even run something like minio and create you own local S3 buckets to test. Plenty of guides on the interwebs.