Channels
academy
amazon
arm
azure
cabpr
chinese
ci-cd
danish
deutsch
developer
elemental
epinio
espanol
events
extensions
fleet
français
gcp
general
harvester
harvester-dev
hobbyfarm
hypper
japanese
k3d
k3os
k3s
k3s-contributor
kim
kubernetes
kubewarden
lima
logging
longhorn-dev
longhorn-storage
masterclass
mesos
mexico
nederlands
neuvector-security
office-hours
one-point-x
onlinemeetup
onlinetraining
opni
os
ozt
phillydotnet
portugues
rancher-desktop
rancher-extensions
rancher-setup
rancher-wrangler
random
rfed_ara
rio
rke
rke2
russian
s3gw
service-mesh
storage
submariner
supermicro-sixsq
swarm
terraform-controller
terraform-provider-rancher2
terraform-provider-rke
theranchcast
training-0110
training-0124
training-0131
training-0207
training-0214
training-1220
ukranian
v16-v21-migration
vsphere
windows
Title
l
loud-daybreak-83328
12/15/2022, 1:05 PMHi. Has anyone successfully used longhorn where /var/lib/longhorn on the worker nodes is stored on an NFS volume?
Specifically when I set up an NFS share on 3 K8S systems for /var/lib/longhorn (each using a different directory on the nfs server), I can't deploy a volume and get this message out of the longhorn manager pod:
time="2022-12-15T13:43:56Z" level=warning msg="Cannot auto salvage volume: no data exists" accessMode=rwx controller=longhorn-volume frontend=blockdev migratable=false node=ktest-k8-2 owner=ktest-k8-2 shareEndpoint= shareState=stopped state=detached volume=pvc-d549713d-a7da-4332-92ca-5ebecf7e0183e
early-magazine-12054
12/15/2022, 3:16 PMYou really should not store the LH volumes on a NFS share. If you have NFS, you already have a persistent storage system somewhere and should rather use that directly.
You'd need a dedicated NFS share for every node running LH, which seems ... a convoluted setup.
What is the motivation for trying to put LH volumes on top of NFS?
l
loud-daybreak-83328
12/15/2022, 3:19 PMI like the abstraction layer that longhorn provides (where users cannot directly access the underlying storage where volumes are kept) as opposed to direct NFS where users have numerous ways of accessing the back-end storage. I have another question in the #general channel about using NFS as back-end storage and getting around some of the permission openness. Do you have experience running NFS as a back-end with restrictive use? That's really what I'm ultimately after.
e
early-magazine-12054
12/15/2022, 3:22 PMYes, I think that's mostly what you should aim for, I'd think (unless you've got node-local storage that LH can leverage). And unfortunately, I don't have that experience with NFS servers in a k8s context, it probably also depends on the NFS service you're leveraging.
l
loud-daybreak-83328
12/15/2022, 3:24 PMThanks for the help