How do you force delete a node that is stuck provisioning, when the backing VM is already delete? I Have 3 nodes that somehow used the wrong machine template stuck: Waiting for VMware Tools to come online...; waiting on node-controller

I want to follow this as well. The only thing we found is that if the HASH of that machine pool is trying to provision the only way to stop is to get it to a good state, like apply another change that rolls it back or gives it the correct settings on the VM side to make the nodes roll to the correct state. This has a side effect that the bad HASH version is still creating and deleting VM's... On the other hand if you are trying to delete a machine, and the VM is gone. You may have to remove the finalizer on the machine to get it to properly go

How do you go about removing the finalizer?

right, on the management server you will need to edit the machine that is in the bad state and find the finalizer section and delete them

I’m lost on getting it from the management server.

p-* is a project c-* is a cluster, looks like a whole cluster is in process of being deleted including the projects

That’s not even a valid cluster anymore.

you might need to track that down if it keep coming back, probably another CRD is triggering it