Channels
academy
amazon
arm
azure
cabpr
chinese
ci-cd
danish
deutsch
developer
elemental
epinio
espanol
events
extensions
fleet
français
gcp
general
harvester
harvester-dev
hobbyfarm
hypper
japanese
k3d
k3os
k3s
k3s-contributor
kim
kubernetes
kubewarden
lima
logging
longhorn-dev
longhorn-storage
masterclass
mesos
mexico
nederlands
neuvector-security
office-hours
one-point-x
onlinemeetup
onlinetraining
opni
os
ozt
phillydotnet
portugues
rancher-desktop
rancher-extensions
rancher-setup
rancher-wrangler
random
rfed_ara
rio
rke
rke2
russian
s3gw
service-mesh
storage
submariner
supermicro-sixsq
swarm
terraform-controller
terraform-provider-rancher2
terraform-provider-rke
theranchcast
training-0110
training-0124
training-0131
training-0207
training-0214
training-1220
ukranian
v16-v21-migration
vsphere
windows
Title
p
powerful-elephant-25838
05/09/2023, 10:39 AMRKE2 with cilium on Ubuntu 22.04 on VMWare is not working, node reachable but endpoints NO. The internal communication between nodes not working. Any support on this?
k
kind-air-74358
05/10/2023, 3:12 PMAre you actually using NSX-t with VMWare?
p
powerful-elephant-25838
05/11/2023, 5:41 PMNo we are using nsx-v
k
kind-air-74358
05/11/2023, 6:52 PMWe had some similar issues on our side using nsx-t. We still don’t have a clear understanding of the issue, but it looks that this command will somehow fix it:
ethtool -K cilium_vxlan tx-checksum-ip-generic off(So not a very good fix unfortunatly)
And we verified it also against an RKE2 with Cilium on Ubuntu 22.04 on vSphere 8 without nsx-t which is working fine as far as I can tell now
p
powerful-elephant-25838
05/11/2023, 6:56 PMgot this from cilium slack: https://docs.cilium.io/en/stable/operations/system_requirements/#systemd-based-distributions
k
kind-air-74358
05/11/2023, 6:58 PMI’ll give this a look tomorrow. Thanks for the link
👍 1
p
powerful-elephant-25838
05/11/2023, 6:59 PMI will also try it in the next days, we have other activities scheduled and for now we reverted to 20.04 that works smoothly
👍 1
a
acoustic-addition-45641
05/15/2023, 6:11 PMRan into this same issue today. Ran the "ethtool -K cilium_vxlan tx-checksum-ip-generic off" command, and the Cilium connectivity test passes.
This was after making the adjustments to account for foreign routes in Ubuntu 22.04 (before installing RKE2+Cilium).
By chance, did you happen to figure out how to make the ethtool changes permanent?
Added the command as a crontab that runs every 5 minutes. This is "good enough" for now. Hopefully VMWare will resolve this at some point.
k
kind-air-74358
05/16/2023, 6:59 AMNo unfortunately we didn’t found a solution yet. One possible solution is mention is this thread: https://github.com/projectcalico/calico/issues/4727. But not tested the change of vxlan port yet
👍 1
p
powerful-elephant-25838
05/24/2023, 12:23 PMtested it and seems that setting "tunnelPort: 4789" make it work; we have VMWare with nsx
🙌 1
👍 1