I am unable to get a custom hybrid linux windows rke2 cluste rancher-users #rke2

Title

# rke2

millions-ocean-48249

03/06/2023, 8:50 PM

I am unable to get a custom hybrid (linux/windows) rke2 cluster working with the vSphere cloud provider/ vSphere csi enabled. The Windows nodes never get initialized... Can someone point me in the right direction here?

linux rke2 version: v1.24.9+rke2r2

windows rke2 version: v1.24.9

rancher version: 2.7.1

vsphere version: 7.0.3

linux nodes: ubuntu 22.04 (open-vm-tools)

windows nodes: windows server core 2019 ltsc (vmtools version:12320)

After registering all the nodes with the cluster, the linux nodes get initialized properly and the taint is removed, however, the windows nodes do not get initialized properly and I can see the following in the vsphere-cpi-cloud-manager-controller logs:

Copy code

I0303 16:39:27.155021 1 node_controller.go:391] Initializing node sre-b89d40bd1vq with cloud provider
I0303 16:39:27.155095 1 search.go:76] WhichVCandDCByNodeID nodeID: sre-b89d40bd1vq
I0303 16:39:27.181513 1 search.go:208] Found node sre-b89d40bd1vq as vm=VirtualMachine:vm-18616 in vc=x.x.x.x and datacenter=dc1
I0303 16:39:27.181675 1 search.go:210] Hostname: SRE-B89D40BD1VQ, UUID: 4211dcfa-7a40-fae2-bd0c-d694c118c50b
I0303 16:39:27.181764 1 nodemanager.go:127] Discovered VM using FQDN or short-hand name
E0303 16:39:27.187892 1 node_controller.go:213] error syncing 'sre-b89d40bd1vq': failed to get provider ID for node sre-b89d40bd1vq at cloudprovider: failed to get instance ID from cloud provider: VM GuestNicInfo is empty, requeuing

the only thing I have noticed that is a bit odd, is once I run the command to connect the windows nodes to the cluster, vmtools stops reporting the IP in the UI. I am not sure if this is something related to the cni that gets created potentially or what. I am using calico as required in the documentation.

creamy-pencil-82913

03/06/2023, 9:02 PM

the vmware docs suggest that this is an issue with the vmware tools installed on your Windows nodes https://kb.vmware.com/s/article/81054

• From the host vSphere API, VM GuestInfo.net is empty NicInfo array while GuestInfo.ipAddress exists

• From the vCenter Server UI, the VM summary tab does not show a VM IP address

> Cause

This issue occurs when there are too many network interface entries found in guest OS by VMware Tools (version 10.2.0 and later).

millions-ocean-48249

03/06/2023, 9:16 PM

hi @creamy-pencil-82913 thank you for the response. I will test adding a config file entry to ignore other interfaces. out of curiosity is this something others have reported experiencing when setting up hybrid clusters?

creamy-pencil-82913

03/06/2023, 9:20 PM

I’ve not seen a report of that before, no

busy-lamp-70104

10/03/2023, 12:41 PM

I got the same issue right now. Exact the same. Anyone managed to solve this ?

19 Views