https://rancher.com/ logo
Title
i

icy-agency-38675

05/25/2023, 7:20 AM
It seems two different issues. Do you use RWX volumes?
b

bitter-tailor-6977

05/25/2023, 7:24 AM
yes i use RWX volumes
i

icy-agency-38675

05/25/2023, 7:24 AM
Can you provide 1. support bundle 2.
dmesg -T
of each worker node
b

bitter-tailor-6977

05/25/2023, 7:26 AM
sure
mail id ?
i

icy-agency-38675

05/25/2023, 7:28 AM
b

bitter-tailor-6977

05/25/2023, 7:28 AM
yup
i

icy-agency-38675

05/25/2023, 7:30 AM
Thank you. Will check it soon after you provide the information. TBH, the stuck NFS client/server cases are sometimes caused by the operation system itself, and the restart of the worker node might be needed. But, before that, we can check support bundle first.
b

bitter-tailor-6977

05/25/2023, 7:32 AM
right now nfs is fine after restarting the server…still you need support bundle now ?
i

icy-agency-38675

05/25/2023, 7:32 AM
BTW, we recommend upgrade longhron-system to v1.4.2. Some rwx volumes issues are fixed.
right now nfs is fine after restarting the server…still you need support bundle now ?
Yes, you can provide us 1. support bundle 2.
dmesg -T
of each worker node After that, you can restart the worker node as a workaround.
b

bitter-tailor-6977

05/25/2023, 7:34 AM
yup i ll provide, i mean to say the issue and log i provide was happened late night yesterday and we fixed the issue by rebooting the machine…
i

icy-agency-38675

05/25/2023, 7:34 AM
Ah, got it. Thank you.
b

bitter-tailor-6977

05/25/2023, 7:35 AM
but how we can prevent this - “the stuck NFS client/server cases are sometimes caused by the operation system itself”
i

icy-agency-38675

05/25/2023, 7:38 AM
We are still checking the root cause. However, we found it sometimes caused by the • Unstable network environment • Some issues related to OSes
b

bitter-tailor-6977

05/25/2023, 7:41 AM
sent you the mail, pls check and revert back
any active issue we are tracking on this or should i raise the issue in longhorn ?
i

icy-agency-38675

05/25/2023, 7:43 AM
Have you create a ticket in the github longhorn/longhorn repo?
b

bitter-tailor-6977

05/25/2023, 7:43 AM
not yet
i

icy-agency-38675

05/25/2023, 7:44 AM
You can create one and add the information. We will check it.
b

bitter-tailor-6977

05/25/2023, 7:44 AM
ok sure mean time, i shared the mail aswell…just update me ASAP…becz we are in the production so this analysis will help m for RCA… and curious to know one more thing, how due to this k3s cluster itself going to Node not ready state any idea ?
i

icy-agency-38675

05/25/2023, 7:45 AM
🤔 No idea for now. It seems not related to Longhorn from the log message.
b

bitter-tailor-6977

05/25/2023, 7:48 AM
so nfs server not responding and k3s server went to
"node not ready"
both diff issue ? hmmmmm 🤯
but asper logs after nfs server error…k3s issue occured…
i

icy-agency-38675

05/25/2023, 7:58 AM
It should be not related from the RWX volume’s perspective. 🤔