https://rancher.com/ logo
Join Slack
Powered by
This message was deleted.
# general
a
This message was deleted.
w
unclear if it's related, but i have alerts saying ~28% of them are down
pushprox stuff is not related. I recycled the nodes and they went away
2024/02/08 025815 [ERROR] error syncing 'c-m-ncbbc87n': handler cluster-deploy: Get "https://10.43.0.1:443/apis/apps/v1/namespaces/cattle-system/daemonsets/cattle-node-agent": cluster agent disconnected, requeuing Wed, Feb 7 2024 95815 pm
response 400: cluster not found websocket: bad handshake
hmm
Copy code
fleet-agent
time="2024-02-08T04:27:37Z" level=info msg="Deploying bundle cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local"
2024-02-08T04:27:37.499306751Z time="2024-02-08T04:27:37Z" level=info msg="Helm: Installing fleet-agent-local"
Wed, Feb 7 2024 11:27:37 pm
time="2024-02-08T04:27:37Z" level=info msg="getting history for release fleet-agent-local"
Wed, Feb 7 2024 11:27:37 pm
time="2024-02-08T04:27:37Z" level=error msg="error syncing 'cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local': handler bundle-deploy: cannot re-use a name that is still in use, requeuing"
Wed, Feb 7 2024 11:27:57 pm
time="2024-02-08T04:27:57Z" level=info msg="Deploying bundle cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local"
2024-02-08T04:27:57.722085817Z time="2024-02-08T04:27:57Z" level=info msg="Helm: Installing fleet-agent-local"
Wed, Feb 7 2024 11:27:57 pm
time="2024-02-08T04:27:57Z" level=error msg="error syncing 'cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local': handler bundle-deploy: cannot re-use a name that is still in use, requeuing"
Wed, Feb 7 2024 11:30:48 pm
time="2024-02-08T04:30:48Z" level=info msg="Deleting orphan bundle ID k3s, release kube-system/traefik"
Wed, Feb 7 2024 11:37:57 pm
time="2024-02-08T04:37:57Z" level=info msg="Deploying bundle cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local"
Wed, Feb 7 2024 11:37:58 pm
time="2024-02-08T04:37:58Z" level=info msg="Helm: Installing fleet-agent-local"
Wed, Feb 7 2024 11:37:58 pm
time="2024-02-08T04:37:58Z" level=info msg="getting history for release fleet-agent-local"
Wed, Feb 7 2024 11:37:59 pm
time="2024-02-08T04:37:59Z" level=error msg="error syncing 'cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local': handler bundle-deploy: cannot re-use a name that is still in use, requeuing"
2024-02-08T04:47:59.143796101Z time="2024-02-08T04:47:59Z" level=info msg="Deploying bundle cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local"
Wed, Feb 7 2024 11:47:59 pm
time="2024-02-08T04:47:59Z" level=info msg="Helm: Installing fleet-agent-local"
2024-02-08T04:47:59.486609641Z time="2024-02-08T04:47:59Z" level=info msg="getting history for release fleet-agent-local"
Wed, Feb 7 2024 11:47:59 pm
time="2024-02-08T04:47:59Z" level=error msg="error syncing 'cluster-fleet-local-local-1a3d67d0a899/fleet-agent-local': handler bundle-deploy: cannot re-use a name that is still in use, requeuing"
ok, 2.7.9 => 2.8.1 broken. Downgraded to 2.8 then 2.8.1. Works now.
Thanks @ambitious-plastic-3551 😄
👍 1
s
@wonderful-rain-13345 did you happen to grab the cluster agent logs while you were on 2.8.1 (the first time, when you were seeing the issue)? If so, would you mind providing them (please give them a look first and make sure you are ok with sharing the content publicly)?
w
I did not. Which cluster would have them?
Rancher or my downstream.?
s
Downstream - particularly the 
c-m-ncbbc87n
cluster (above you noted that it was disconnected at least for a time, might be a good place to start). You are looking for a pod with the format 
cattle-cluster-agent
(will have a random suffix) in the 
cattle-system
namespace.
w
Ok let me see if I can maybe get them using previous logs
👍 1
Open in Slack
PreviousNext
Powered by