https://rancher.com/ logo
Join Slack
Powered by
This message was deleted.
# longhorn-storage
a
This message was deleted.
a
Hi is the log from the longhorn-manager in cluster B after you set up the BackupTarget?
n
Yes, it is!
a
Can you provide your longhorn version? Thanks
n
both cluster runs with 1.4.0LH.
a
The way you are using backup is correct But I haven't encountered this kind of crash before Can you provide the support bundle from both ClusterA and ClusterB? Thanks!
n
yes, I will check this
do you think it is possible that a corrupted S3 data content could cause such a problem? our Minio S3 server had to be restored from backup, I am increasingly suspicious that some files were not restored correctly
a
can you login to minio to find the volume cfg? it should be in
Copy code
backupstore/volumes/xx/xx/pvc-609e82a6-853e-43c7-b2d4-cabad74304a6/volume.cfg
it should have Labels this field even it is empty, but in your case it seems this field was gone and caused nil pointer
n
i think you're right!
Copy code
time="2023-09-01T09:04:13Z" level=error msg="Error listing backups from backup target" backupVolume=pvc-3ee6b751-a357-4cbe-9e28-0762f822d46b controller=longhorn-backup-volume error="cannot find backupstore/volumes/cb/be/pvc-3ee6b751-a357-4cbe-9e28-0762f822d46b/volume.cfg in backupstore" node=n107
time="2023-09-01T09:04:13Z" level=error msg="Error listing backups from backup target" backupVolume=pvc-8994e7a4-b6f2-4500-b9e2-b0e95de193a9 controller=longhorn-backup-volume error="cannot find backupstore/volumes/59/41/pvc-8994e7a4-b6f2-4500-b9e2-b0e95de193a9/volume.cfg in backupstore" node=n107
I have pvc-xxxxx directories that are missing the volume.cfg file
👍 1
many thanks for your help!
a
You can try to backup the volume from clusterA again Longhorn will try to create the volume.cfg back
n
OK, I'll try it
do you think it is a correct procedure to save the data content of our Minio S3 server? the Longhorn backs up to minio e.g. daily and we keep 10 backups but it may be the case that pv content from several months ago needs to be checked by the developers. In such a case, do you think it is a viable way to restore S3 content and from there the Longhorn Pv?
a
You mean even though you only keep 10 backups but you also backup the Minio it self, so you are still able to restore minio to months ago and find the backup at the time? Wouldn't that lead to the conflicts to the current Minio content?
n
yes, that's what I meant
in such a case I will of course restore to another directory, I don't want to mess up the currents data content
a
I think there is nothing wrong in this procedure
❤️ 1
2 Views
Open in Slack
PreviousNext
Powered by