This message was deleted.
# longhorn-storagea
adamant-kite-43734
03/24/2023, 11:48 PMThis message was deleted.
q
quiet-area-89381
03/25/2023, 12:11 AMI see the complete log
Copy code
longhorn-csi-plugin-6bh98 longhorn-csi-plugin 2023-03-24T17:09:28.445862278-07:00 time="2023-03-25T00:09:28Z" level=error msg="NodeStageVolume: err: rpc error: code = Internal desc = format of disk \"/dev/longhorn/pvc-2e1be23b-4021-45d2-878b-d37cd71679dc\" failed: type:(\"ext4\") target:(\"/var/snap/microk8s/common/var/lib/kubelet/plugins/kubernetes.io/csi/driver.longhorn.io/c072c61d6cbcb55eac5a9120cce1da05cba3ab07bb0b540278a9cfcc67b87887/globalmount\") options:(\"defaults\") errcode:(exit status 1) output:(mke2fs 1.46.4 (18-Aug-2021)\n/dev/longhorn/pvc-2e1be23b-4021-45d2-878b-d37cd71679dc is apparently in use by the system; will not make a filesystem here!\n) "quiet-area-89381
03/25/2023, 12:13 AMlooks very similar to this problem https://github.com/longhorn/longhorn/issues/3177
quiet-area-89381
03/25/2023, 12:17 AMand problably the manual fix on the kubelet nodes running longhorn https://longhorn.io/kb/troubleshooting-volume-with-multipath/
quiet-area-89381
03/25/2023, 12:18 AMI do see the multipath on the longhorn devices
quiet-area-89381
03/25/2023, 12:38 AMI change the config of multipathd on all nodes to blacklist the /dev/sdXXX devices. Now my pods can mount their PV. Success! Not sure why I didn't know about that important setting. I had never seen it anywhere in longhorn main doc/helm chart.
quiet-area-89381
03/25/2023, 12:39 AMMaybe my other issues are related to that, so I hold on to my other questions for a few days. 😄
324 Views