i have a harvester cluster running 1.5.1 (upgraded...
# harvester
b
i have a harvester cluster running 1.5.1 (upgraded from 1.3.x over the last > year). i have new nodes installed from iso, and they aren't joining the cluster. i see an error on the new nodes:
Copy code
rancher-system-agent[2796]: W0804 22:47:30.831275    2796 reflector.go:492] pkg/mod/k8s.io/client-go@v0.32.2/tools/cache/reflector.go:251: watch of *v1.Secret ended with: an error on the server ("unable to decode an event from the watch stream: stream error: stream ID 29; INTERNAL_ERROR; received from peer") has prevented the request from succeeding
any suggestions what might be wrong or how to debug this?
answering my own question, the cluster was just over a year old, and the certs for kube-scheduler and kube-controller-manager were expired. moving
/var/lib/rancher/rke2/server/tls/kube-{scheduler,controller-manager}/*
out of the way and restarting the containers (
crictl rm -f $(crictl ps -q --name kube-scheduler)
and again for
kube-controller-manager
) worked
👍 2
🙌 2