I ran the steps to recover etcd without a snapshot, we now have a new etcd with one member but the cluster will not come up. I'm not sure what else to do. Is there any type of Rancher technical support we can buy for this one issue by the hour?
I'm dont have much experience with Rancher and don't want to dig a deeper hole guessing
currently in rancher gui it says "Failed to ensure monitoring project name: failed to find "cattle-prometheus" Namespace: Get https://126.96.36.199:6443/api/v1/namespaces/cattle-prometheus?timeout=30s: waiting for cluster agent to connect; failed to start backup server on all etcd nodes: [Failed to run backup server container, container logs: time="2023-01-05T15:38:00Z" level=fatal msg="stat /backup/c-hztls-rl-4km8z_2023-01-02T07:39:55Z: no such file or directory"
01/09/2023, 1:36 AM
You can try manually starting the cattle agent in the master node by connecting over ssh