https://rancher.com/ logo
Title
n

narrow-noon-75604

09/22/2022, 11:05 AM
Hi, I am using an RKE2 cluster with 1 master node and 5 worker nodes. I have deployed longhorn as a storage class and deployed a mongodb application. Longhorn successfully created the PV and it is bound state as well but the pod is not into Running state because the volume is not attached to any of the worker nodes. Found that "/dev/longhorn" folder is missing in all the worker nodes. Also the "instance-manager" pods are throwing the following error,
[pvc-28f57305-2b5b-44c8-9447-549101dea147-e-ded1735d] time="2022-09-22T10:59:13Z" level=warning msg="FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/1/ns/mnt --net=/host/proc/1/ns/net iscsiadm -m discovery -t sendtargets -p 10.42.50.26], output , stderr, iscsiadm: Cannot perform discovery. Invalid Initiatorname.\niscsiadm: Could not perform SendTargets discovery: invalid parameter\n, error exit status 7"
[pvc-28f57305-2b5b-44c8-9447-549101dea147-e-ded1735d] time="2022-09-22T10:59:13Z" level=warning msg="Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-28f57305-2b5b-44c8-9447-549101dea147"
I am not sure what I am missing. Any suggestions would be appreciated.
q

quick-sandwich-76600

09/22/2022, 3:28 PM
Hi, Seems similar to what is described in this GitHub issue: https://github.com/longhorn/longhorn/issues/4324 May you have a look and try the solution provided there?
n

narrow-noon-75604

09/22/2022, 3:29 PM
Hi @quick-sandwich-76600
I think the issue is the volumes are stuck in a loop trying to attach/detach to worker nodes. I see this is a bug reported in 1.2.4 and addressed in 1.2.5
q

quick-sandwich-76600

09/22/2022, 3:46 PM
But you are installing the latest version (1.3.1), is that right?
n

narrow-noon-75604

09/22/2022, 3:49 PM
No I am using 1.2.4 and I see 1.2.5 is the latest from here - https://github.com/longhorn/longhorn/releases
q

quick-sandwich-76600

09/22/2022, 4:03 PM
Out of curiosity .... why do you use the old version?
n

narrow-noon-75604

09/22/2022, 4:08 PM
I have used it some months ago and it worked fine but when I try to use the same in a new cluster now, I am facing this issue
q

quick-sandwich-76600

09/22/2022, 4:12 PM
Yes, I get that, but there are a lot of updates on 1.3.1, so if you are starting with a new cluster/deployment, it's better to go for the latest version.
n

narrow-noon-75604

09/22/2022, 4:22 PM
I am unable to find the 1.3.1 version. can you please share the latest release url?
q

quick-sandwich-76600

09/22/2022, 4:33 PM
Sure: https://github.com/longhorn/longhorn/releases/tag/v1.3.1 1.2.5 update was the last released version chronologically, so that's why it seems the most recent on GitHub. Sometimes that creates confusion.
n

narrow-noon-75604

09/22/2022, 4:37 PM
Thanks much @quick-sandwich-76600 for the info
I have another doubt...I see that 1.2.5 is the latest released version
c

creamy-pencil-82913

09/22/2022, 5:10 PM
like Juan said, GH sorts tags chronologically, not by version. So 1.2.5 is the most recent release, but not the newest from a code perspective.
tl;dr use the highest version, not the newest
n

narrow-noon-75604

09/22/2022, 5:18 PM
Thanks @creamy-pencil-82913 I will go with 1.2.5 then and see if the issue still persists
c

creamy-pencil-82913

09/22/2022, 6:23 PM
that’s not what I was suggesting at all but ok
s

steep-furniture-72588

09/24/2022, 6:53 AM
Ok in your new cluster does it have the iscsi package? ( I can't remember the full title of the package).