bored-school-93100
05/09/2023, 8:02 AMbored-school-93100
05/10/2023, 7:46 AMbored-school-93100
05/10/2023, 7:47 AMworried-electrician-89379
05/10/2023, 8:16 AMbored-school-93100
05/10/2023, 9:36 AMcool-thailand-26552
05/10/2023, 11:20 AMbored-school-93100
05/10/2023, 11:56 AMbored-school-93100
05/15/2023, 7:38 AMbored-school-93100
05/25/2023, 7:54 AMbored-school-93100
05/25/2023, 7:55 AMrapid-van-91305
06/05/2023, 10:54 AMmagnificent-state-70880
06/06/2023, 12:00 PMI0606 09:00:08.056514 1 rke2controlplane_controller.go:259] "msg"="Ready Machine :" "RKE2ControlPlane"={"name":"management-cluster-control-plane","namespace":"default"} "controller"="rke2controlplane" "controllerGroup"="<http://controlplane.cluster.x-k8s.io|controlplane.cluster.x-k8s.io>" "controllerKind"="RKE2ControlPlane" "machine-name"="management-cluster-control-plane-kgnrr" "name"="management-cluster-control-plane" "namespace"="default" "reconcileID"="365d1f12-30b5-4e65-bc81-56669f968632"
E0606 09:00:08.062775 1 rke2controlplane_controller.go:152] "msg"="Failed to update RKE2ControlPlane Status" "error"="some Control Plane machines exist and are ready but they have no IP Address available" "RKE2ControlPlane"={"name":"management-cluster-control-plane","namespace":"default"} "cluster"="management-cluster" "controller"="rke2controlplane" "controllerGroup"="<http://controlplane.cluster.x-k8s.io|controlplane.cluster.x-k8s.io>" "controllerKind"="RKE2ControlPlane" "name"="management-cluster-control-plane" "namespace"="default" "reconcileID"="365d1f12-30b5-4e65-bc81-56669f968632"
E0606 09:00:08.063894 1 controller.go:326] "msg"="Reconciler error" "error"="some Control Plane machines exist and are ready but they have no IP Address available" "RKE2ControlPlane"={"name":"management-cluster-control-plane","namespace":"default"} "controller"="rke2controlplane" "controllerGroup"="<http://controlplane.cluster.x-k8s.io|controlplane.cluster.x-k8s.io>" "controllerKind"="RKE2ControlPlane" "name"="management-cluster-control-plane" "namespace"="default" "reconcileID"="365d1f12-30b5-4e65-bc81-56669f968632"
From the code in the RKE2 controPlane controller, it seems that it tries to retrieve a valid IP address for the ready control plane node, but the results is that it doesn't find any valid IP address. The code checks for both InternalIP and ExternalIP in the Machine CRD resource, I report here the Machine CRD I have for the control plane node:
Name: management-cluster-control-plane-kgnrr
Namespace: default
Labels: <http://cluster.x-k8s.io/cluster-name=management-cluster|cluster.x-k8s.io/cluster-name=management-cluster>
<http://cluster.x-k8s.io/control-plane=|cluster.x-k8s.io/control-plane=>
<http://node.cluster.x-k8s.io/esxi-host=|node.cluster.x-k8s.io/esxi-host=><HOST IP ADDRESS>
Annotations: <http://controlplane.cluster.x-k8s.io/rke2-server-configuration|controlplane.cluster.x-k8s.io/rke2-server-configuration>: {"disableComponents":{},"cni":"calico","etcd":{"backupConfig":{}}}
API Version: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
Kind: Machine
Metadata:
Creation Timestamp: 2023-06-01T14:49:37Z
Finalizers:
<http://machine.cluster.x-k8s.io|machine.cluster.x-k8s.io>
Generation: 3
Managed Fields:
API Version: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
Fields Type: FieldsV1
fieldsV1:
f:metadata:
f:annotations:
.:
f:<http://controlplane.cluster.x-k8s.io/rke2-server-configuration|controlplane.cluster.x-k8s.io/rke2-server-configuration>:
f:finalizers:
.:
v:"<http://machine.cluster.x-k8s.io|machine.cluster.x-k8s.io>":
f:labels:
.:
f:<http://cluster.x-k8s.io/cluster-name|cluster.x-k8s.io/cluster-name>:
f:<http://cluster.x-k8s.io/control-plane|cluster.x-k8s.io/control-plane>:
f:<http://node.cluster.x-k8s.io/esxi-host|node.cluster.x-k8s.io/esxi-host>:
f:ownerReferences:
.:
k:{"uid":"8080a6c3-49db-4bd0-bb81-60d475f98d6c"}:
f:spec:
.:
f:bootstrap:
.:
f:configRef:
f:dataSecretName:
f:clusterName:
f:infrastructureRef:
f:providerID:
f:version:
Manager: manager
Operation: Update
Time: 2023-06-01T14:51:03Z
API Version: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
Fields Type: FieldsV1
fieldsV1:
f:status:
.:
f:addresses:
f:bootstrapReady:
f:conditions:
f:infrastructureReady:
f:lastUpdated:
f:observedGeneration:
f:phase:
Manager: manager
Operation: Update
Subresource: status
Time: 2023-06-01T14:58:20Z
Owner References:
API Version: <http://controlplane.cluster.x-k8s.io/v1alpha1|controlplane.cluster.x-k8s.io/v1alpha1>
Block Owner Deletion: true
Controller: true
Kind: RKE2ControlPlane
Name: management-cluster-control-plane
UID: 8080a6c3-49db-4bd0-bb81-60d475f98d6c
Resource Version: 4473
UID: 08fc8851-837c-453f-8db8-d7bff8d4a6c7
Spec:
Bootstrap:
Config Ref:
API Version: <http://bootstrap.cluster.x-k8s.io/v1alpha1|bootstrap.cluster.x-k8s.io/v1alpha1>
Kind: RKE2Config
Name: management-cluster-control-plane-tb6gk
Namespace: default
UID: 38419d0a-d19e-4596-b827-a5107d19baab
Data Secret Name: management-cluster-control-plane-tb6gk
Cluster Name: management-cluster
Infrastructure Ref:
API Version: <http://infrastructure.cluster.x-k8s.io/v1beta1|infrastructure.cluster.x-k8s.io/v1beta1>
Kind: VSphereMachine
Name: management-cluster-control-plane-jkmhg
Namespace: default
UID: 91393bdf-812b-43d9-9f54-8880cc78fb08
Node Deletion Timeout: 10s
Provider ID: <vsphere://42351d94-6626-4ddb-ed61-5559bd9ffa8b>
Version: v1.24.12+rke2r1
Status:
Addresses:
Address: <IP ADDRESS>
Type: ExternalIP
Bootstrap Ready: true
Conditions:
Last Transition Time: 2023-06-01T14:50:53Z
Status: True
Type: Ready
Last Transition Time: 2023-06-01T14:49:37Z
Status: True
Type: BootstrapReady
Last Transition Time: 2023-06-01T14:50:53Z
Status: True
Type: InfrastructureReady
Last Transition Time: 2023-06-01T14:58:20Z
Reason: NodeProvisioning
Severity: Warning
Status: False
Type: NodeHealthy
Infrastructure Ready: true
Last Updated: 2023-06-01T14:51:03Z
Observed Generation: 3
Phase: Provisioned
Events: <none>
For security reasons, I substituted the IP address with "<IP ADDRESS>" you see in "Address" field. This IP is assigned by a DHCP server, and it should be the one that the controller picks up for the control plane node, but this does not happen and I got the error mentioned above. May it be related to an implementation problem? Or is there a specific configuration needed that I am missing? Thanks in advance for the answerbored-school-93100
06/07/2023, 9:24 AMrapid-van-91305
06/07/2023, 9:30 AMrapid-van-91305
06/07/2023, 9:30 AMastonishing-eve-43840
06/13/2023, 8:02 AMrapid-van-91305
06/19/2023, 4:14 PMbillions-london-49866
06/29/2023, 4:27 PMcool-thailand-26552
06/29/2023, 4:27 PMbillions-london-49866
06/29/2023, 4:28 PMbillions-london-49866
06/29/2023, 4:28 PMbillions-london-49866
06/29/2023, 4:29 PMcool-thailand-26552
06/29/2023, 6:24 PMrapid-van-91305
06/30/2023, 6:48 AMrapid-van-91305
06/30/2023, 6:49 AMrapid-van-91305
06/30/2023, 3:17 PMaddress
registration method.rapid-van-91305
06/30/2023, 3:22 PMabundant-camera-87627
07/12/2023, 12:51 PMcapi-kubeadm-bootstrap-controller-manager
shows the error failed calling webhook \"<http://rancher.cattle.io|rancher.cattle.io>.secrets\": failed to call webhook: Post \"<https://rancher-webhook.cattle-system.svc:443/v1/webhook/mutation/secrets?timeout=10s>\" dial tcp 10.x.x.x.:443: connect: connection refused
repeatedly, preventing machines from being provisioned. I tried (for troubleshooting) deleting the webhook rancher.cattle.io.secrets
and even deleting the entire mutatingwebhookconfiguration `rancher.cattle.io`; but the issue persists.important-yacht-1017
07/15/2023, 1:19 AMcreamy-wolf-46823
08/08/2023, 8:58 AM