I'm not really my question should come to group harvester or rancher. But how can I force removing the clusters that I no longer need? They seemed to be stuck as below for a long time, after I click deleting them.

You can go to the Harvester UI and remove the VMs.