Good Noon Everyone, Would need your support and help with following issue. I am setting up Production rancher HA setup using RKE2 on vSphere vcenter. I have installed Rancher controller successfully and able to access the racher UI but now while creating downstream rancher clusters facing error

error syncing '_all_': handler user-controllers-controller: userControllersController: failed to set peers for key _all_: failed

in the logs of rancher pod and in the UI it shows following error.

2023/08/13 08:38:17 [ERROR] error syncing '_all_': handler user-controllers-controller: userControllersController: failed to set peers for key _all_: failed to start user controllers for cluster c-m-h2s57fh6: ClusterUnavailable 503: cluster not found, requeuing