hi all - getting particularly poor performance on 2 node cluster running k3s with 25G networking between nodes. Seeing 29MB/s to LH. iperf betweeen nodes shows 25Gbps, pod to opposite host is around 7Gbps (not sure why) and write to the disks locally is closer to 250MB/s. Where would you look here?

I guess you tried the basics like ping replies between hosts, DD output writes to the disks you are using for longhorn (is your disks seperate e.g. another LVM group?

Longhorn team already did some performance tests. Here I am not sure why… Are you using RWX volumes? https://github.com/longhorn/longhorn/issues/4002