Hi. Looking to see if someone can help me understand cilium with rke2?
Quick context. We're running rocky 8 rke2 canal clusters that have been happy a long time. Recent upgrades to newer rke2 k8s versions have meant we've hit compatibility issues with calico iptables-nft and kube-ptoxy native nftables stuff. Long and short we want to switch to/rebuild with cilium.
The bit I can't get my head around is what traffix path we get from the default rke2-cilium.yaml charts? We wont have new enough kernels to go kube-proxyless until we upgrade to rocky 9. So, if default rke2-cilium charts are installed, we still have ingress-nginx and kube-proxy running? So is cilium just providing vxlan overlay between cluster nodes, and port forwarding all traffic to ingress-nginx and kube-proxy/nftables?
Or do I get some ebpf magic with the default?