victorious-analyst-3332
05/12/2022, 12:59 AM/var/lib/rancher/rke2/server/manifests
approach, but don’t fully understand the ramifications of the AddOn custom resources
detail mentioned there. Thanks a lot for any help you can give.creamy-pencil-82913
05/12/2022, 6:52 AMcareful-piano-35019
05/12/2022, 7:13 AMvictorious-analyst-3332
05/12/2022, 12:02 PMBGPConfig
(to add explicit service/externalIP CIDRs, control BGP communities, and support BGP passwords), BGPPeers
(to add multiple endpoints and node selectors), felixConfiguration
to control iptables/DSR behavior when testing eBPF, and custom IPPools
to control the resource naming to simplify troubleshooting.
Now that we’re testing RKE2 I am curious if we can migrate to the instance that is provided, but we would need a mechanism for applying those custom resources, preferably as part of the same install so we can stop worrying about race conditions where the Rancher v3 API doesn’t include the machine record until after the CNI and network are functioning and cluster-registration has completed.careful-piano-35019
05/12/2022, 12:12 PMvictorious-analyst-3332
05/12/2022, 12:13 PMkubectl apply -f
them so-to-speak during the installcreamy-pencil-82913
05/12/2022, 2:30 PMvictorious-analyst-3332
05/12/2022, 2:47 PMBGPConfiguration
to define prefix advertisements and BGP communities, FelixConfiguration
to configure BPF behaviors, and BGPPeers
to add the explicit peers with node selectors. We also currently define an IPPool
directly via custom resource that matches the operator config options, but that is only to better control the naming (`cluster-node-ippool-10-10-1-0-24' vs default
).creamy-pencil-82913
05/12/2022, 7:34 PMvictorious-analyst-3332
05/12/2022, 7:35 PMcreamy-pencil-82913
05/12/2022, 7:36 PMAny Kubernetes manifests found inwill automatically be deployed to RKE2 in a manner similar to/var/lib/rancher/rke2/server/manifests
. Manifests deployed in this manner are managed as AddOn custom resources, and can be viewed by runningkubectl apply
.kubectl get addon -A
victorious-analyst-3332
05/12/2022, 7:37 PMAddOn custom resources
and how those are processedcreamy-pencil-82913
05/12/2022, 7:38 PMvictorious-analyst-3332
05/12/2022, 7:39 PM