Channels
academy
amazon
arm
azure
cabpr
chinese
ci-cd
danish
deutsch
developer
elemental
epinio
espanol
events
extensions
fleet
français
gcp
general
harvester
harvester-dev
hobbyfarm
hypper
japanese
k3d
k3os
k3s
k3s-contributor
kim
kubernetes
kubewarden
lima
logging
longhorn-dev
longhorn-storage
masterclass
mesos
mexico
nederlands
neuvector-security
office-hours
one-point-x
onlinemeetup
onlinetraining
opni
os
ozt
phillydotnet
portugues
rancher-desktop
rancher-extensions
rancher-setup
rancher-wrangler
random
rfed_ara
rio
rke
rke2
russian
s3gw
service-mesh
storage
submariner
supermicro-sixsq
swarm
terraform-controller
terraform-provider-rancher2
terraform-provider-rke
theranchcast
training-0110
training-0124
training-0131
training-0207
training-0214
training-1220
ukranian
v16-v21-migration
vsphere
windows
Title
b
big-oxygen-89163
05/11/2023, 6:21 AMis longhorn doing raid0 between nodes or is the maxium volume claim < biggest drive?
b
bulky-sunset-52084
05/11/2023, 7:29 PMIt's a dynamically growing volume - longhorn stores all of its blocks on each node that the volume is assigned to. It replicates to all of them. Max volume claim would probably be the size of the smallest disk because once you fill up the disk the replica would fail.
b
big-oxygen-89163
05/11/2023, 7:32 PMgot it, I guess it would work with an ext4 formatted lvm?
b
bulky-sunset-52084
05/11/2023, 7:34 PMI guess I have to ask in what context? At the end of the day it's just a raw block volume exposed to k8s so I'd have to say sure you can format in any way you like.
b
big-oxygen-89163
05/11/2023, 7:36 PMlonghorn only supports ext4/xfs from what I know. so if I wanted to create a VM with 2TB disk and my local node SSD are only 1TB - then I would need to create a srtibe/raid0 and add that to longhorn
b
bulky-sunset-52084
05/11/2023, 7:40 PMLonghorn alone only supports ext4/xfs but harvester uses longhorn as a storage pool for a VM. The VM image is then placed in that longhorn volume and uses the space granted by it. So yes the longhorn volume itself will be ext4/xfs your underlaying VM can be whatever filesystem you like.
b
big-oxygen-89163
05/11/2023, 7:42 PMyes I know that :) just wanted to know if longhorn could stribe disks. But I will try lvm - if it is included in distro
b
bulky-sunset-52084
05/11/2023, 7:47 PMOhh so you want to pool longhorn volumes then with lvm? Can I ask why? That actually is what longhorn is doing under the hood lol so this feels recursive.
So you can have hardware raid-0 on 3 nodes for example and longhorn will create a volume and mirror the data to all 3 nodes simultaneously. Longhorn will use whatever is mounted on /var/lib/longhorn on the node itself as storage for the volumes 'block files'
b
big-oxygen-89163
05/11/2023, 7:50 PMyes but I dont have hardware raid so need to do it in software. so just to understand it, if I have 3 nodes with 2x1TB and a storage class with 3 replica, I can max create 1TB vm disk right? unless there is a raid0 with 2x1TB
💯 1
thanks!
b
bulky-sunset-52084
05/11/2023, 7:52 PMYes that is correct!
b
big-oxygen-89163
05/11/2023, 9:22 PMit seems to work 🙂 great
🙌 1
ok, cluster is not healthy now, so some problems using lvm 😞
failed to update device mount 021f4297329eef8ae98994dada79b2d5: Failed to execute: nsenter [--mount=/host/proc/1/ns/mnt --net=/host/proc/1/ns/net mount -t ext4 -o journal_checksum,journal_ioprio=0,barrier=1,errors=remount-ro,relatime /dev/dm-0 /var/lib/harvester/extra-disks/021f4297329eef8ae98994dada79b2d5], output , stderr, mount: /var/lib/harvester/extra-disks/021f4297329eef8ae98994dada79b2d5: /dev/mapper/longhorn_lvm_group-longhorn_lvm already mounted on /var/lib/harvester/extra-disks/021f4297329eef8ae98994dada79b2d5.
, error exit status 32
a
ancient-pizza-13099
05/12/2023, 2:00 PMseems not a good option to use raid under longhorn
b
big-oxygen-89163
05/12/2023, 2:01 PMhardware raid raid0 should be fine, but software raid not so good
a
ancient-pizza-13099
05/12/2023, 2:02 PMhardware raid works as a total to LH
b
big-oxygen-89163
05/12/2023, 2:03 PMas a total?
a
ancient-pizza-13099
05/12/2023, 2:03 PMLH is more working on distributing data with N copis, rather than connecting N disks into a big ONE.
hardware raid, in the view of LH/Harvester, is a disk
b
big-oxygen-89163
05/12/2023, 2:03 PMyes got it