https://rancher.com/ logo
Title
p

purple-spoon-91771

05/26/2023, 12:17 PM
Hello Guys, i have a Problem with my K3S Server. On my Controll Plane Node i have 100% CPU Load. The K3s Server Version is 1.26.3. How to debug this Issue ? I allready restartet the Node
a

astonishing-mouse-9587

05/26/2023, 12:19 PM
Is your control plane node also running cluster workload or is it dedicated to only being the control plane?
p

purple-spoon-91771

05/26/2023, 12:19 PM
Only for Control Plane
Only 4 Pods running on the Control Plane
a

astonishing-mouse-9587

05/26/2023, 12:21 PM
ps -eo pcpu,pid,user,args | sort -k 1 -r | head -10
This will tell you the top-10 processes that are using the CPU.
p

purple-spoon-91771

05/26/2023, 12:21 PM
%CPU     PID USER     COMMAND
 370   14212 root     /usr/local/bin/k3s server
 3.0     677 root     /usr/bin/litestream replicate
 1.8     414 root     /lib/systemd/systemd-journald
 1.7   20372 root     cilium-agent --config-dir=/tmp/cilium/config-map
 1.6   14291 root     containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd
 0.8     682 syslog   /usr/sbin/rsyslogd -n -iNONE
 0.3     107 root     [kswapd0]
 0.2      43 root     [kcompactd0]
 0.1   21438 root     /velero node-agent server
a

astonishing-mouse-9587

05/26/2023, 12:23 PM
So it is definitely the k3s binary that's doing it.
what version are you running?
p

purple-spoon-91771

05/26/2023, 12:23 PM
1.26.3
a

astonishing-mouse-9587

05/26/2023, 12:24 PM
looking at https://github.com/k3s-io/k3s/issues/294. It looks like it's a recurring issue.
p

purple-spoon-91771

05/26/2023, 12:29 PM
Yeah but i have 100% usage all the time and not 30 - 40%. The API Server is very very slow
a

astonishing-mouse-9587

05/26/2023, 12:30 PM
If one of the Rancher folks don't answer you here I would suggest putting in a new issue with as much detail as you can.