This message was deleted.
# rke2
a
This message was deleted.
c
if you’re using Rancher to provision the cluster, the SUC is used to manage version and configuration of the Rancher System Agent as installed on the nodes. The System Agent in turn manages the installation and configuration of RKE2 on the node, including Kubernetes version upgrades. This is done in order to avoid a dependency loop of having the System Agent manage its own updates.
This is more of a Rancher thing than a RKE2 thing.
b
The reason I asked is that the cluster is flooded with the pods apply-system-agent-upgrader-on-*, each of them with similar errors: ---
apply-system-agent-upgrader-on-phygatapp24-lab-with-2d753-zfhvx
+ TMPDIRBASE=/var/lib/rancher/agent/tmp
+ mkdir -p /host/var/lib/rancher/agent/tmp
mkdir: can't create directory '/host/var/lib/rancher/': No such file or directory
--- I thought it is something to do with cis-1.6 profile, but I disabled it and also have unresticted PSP. Same issue. Appreciate any suggestions on how to fix it.
c
Yeah that’s all managed by Rancher, I’m not sure what might be causing that. Have you looked at the pod logs to see if there are any prior errors? It looks like it’s expecting the host root filesystem to be mounted at /host, is that the case?
What OS are the nodes on?
b
ubuntu 21.04
Could it be because /var/lib/rancher is a link to /kubernetes/rancher?
c
yes that would probably do it
I am not sure there’s going to be an easy fix for that, other than re-rolling your nodes without symlinks in the paths
b
perhaps I’ll need to create a separate fs instead of doing link like I did in RKE1.
it’s POC cluster, expandable. Still looking at RKE2 as a replacement for RKE1
c
yeah, having /var/lib/rancher on another FS should be fine. It’s probably just getting confused by the symlink.
b
I’ll try hardlink. The philosophy behind is to have a separate FS for k8s stuff (pod logs, kubeliet, etcd, …)
so far was working in RKE1
c
you can’t hardlink across filesystems
b
yes, I know, meant other way around, bring kubelet and pods logs to /var/lib/rancher which is a dedicated FS
Thank you Brandon. That was it, symlink. Dedicated FS for /var/lib/rancher resolved the issue.
270 Views