https://rancher.com/ logo
Title
s

stocky-fall-82040

04/25/2023, 12:26 PM
After upgrading from 2.5.17 to 2.6.11 on my Rancher HA cluster, all of my downstream clusters are reporting "Cluster not reporting" agent disconnected. I've logged into the downstream clusters, viewed cluster and cattle agent logs. They show no errors and sit in "starting plan monitoring" state. I've reset the agents, attempted to rejoin the local rancher ha cluster. I do not see any errors in any logs. The local cluster is reachable. Any direction would be appreciated
d

dazzling-smartphone-16726

04/25/2023, 12:37 PM
@stocky-fall-82040 Are you using firewalld or soomething similar?
s

stocky-fall-82040

04/25/2023, 12:56 PM
using iptables on upstream and downstream clusters
Also using RKE1
I just restored my 2.5.17 local cluster and everything is back to working as expected. Something happens during he upgrade process that is breaking communication or is not allowing downstream clusters to report or not allowing the local cluster to sync with the downstream clusters.
d

dazzling-smartphone-16726

04/25/2023, 1:21 PM
Check the ports opened from the documentation, for me temporrary stopping firewalld worked
j

jolly-processor-88759

04/25/2023, 3:57 PM
Sometime you need to restart a single master node for them to connect after Rancher Migrations. Have you tried cordoning and rebooting a single master node in a downstream cluster?