acceptable-salesmen-97792
08/25/2022, 7:59 AMbright-whale-83501
08/25/2022, 2:28 PMfast-umbrella-37090
08/25/2022, 4:15 PMclean-mechanic-4445
08/25/2022, 6:17 PMrefined-toddler-64572
08/25/2022, 7:51 PM1.24.3+k3s1
) on Ubuntu 22.04.1 with ZFS (2.1.4
) and external containerd (1.5.9
). Works GREAT, no day-to-day issues. What I've been struggling with is when K3s uses an external contained -- either kubelet / cadvisor is a bit wonky with metrics in that the image=
and container=
are missing which breaks many dashboards. I can't tell if this is a K3s / kubelet issue, cadvisor issue, containerd issue.. not sure where to seek advise. Kube-Prometheus-Stack is deployed, works well as long as a dashboard doesn't try to use something like container_cpu_usage_seconds_total{image!=""}
returns an empty set as the image
reference is missing, but that does return data when K3s uses bundled containerd. Suggestions welcomed.limited-dress-74620
08/25/2022, 8:10 PMfew-carpenter-10741
08/25/2022, 9:26 PMworried-activity-29498
08/26/2022, 7:37 AMmodern-france-56449
08/26/2022, 8:34 AMmodern-france-56449
08/26/2022, 8:35 AMmodern-france-56449
08/26/2022, 8:35 AMmodern-france-56449
08/26/2022, 8:38 AMmodern-france-56449
08/26/2022, 8:38 AMmodern-france-56449
08/26/2022, 8:40 AMmodern-france-56449
08/26/2022, 8:42 AMmodern-france-56449
08/26/2022, 8:43 AMmodern-france-56449
08/26/2022, 8:44 AMmodern-france-56449
08/26/2022, 8:45 AMmodern-france-56449
08/26/2022, 8:45 AMmodern-france-56449
08/26/2022, 8:47 AMmodern-france-56449
08/26/2022, 8:47 AMmodern-france-56449
08/26/2022, 8:47 AMchilly-caravan-31853
08/26/2022, 10:22 AM--cluster-init
argument, then added two more Nodes B and C with the --server A
argument. All seemed fine, but after I shut down all the three nodes and then start B and C only, the cluster is not operational (k3s kubectl get nodes
on Node B gives the "apiserver not ready" error). What am I missing? Is the first A node still special and a single point of failure?
It is also strange that I cannot locate an etcd pod on any of the nodes when they are running normally.great-magician-27293
08/26/2022, 10:36 AMgreat-magician-27293
08/26/2022, 10:39 AMenough-xylophone-4568
08/26/2022, 2:03 PMError response from daemon: Head \"<https://foo.azurecr.io/v2/rancher/rancher-agent/manifests/v2.6.7>\": unauthorized: authentication required, visit <https://aka.ms/acr/authorization> for more information.
I had a look at the source code, and I believe it crashes when trying to pull the share-mnt
process image, which has no imageRegistryAuthConfig
settings section in the nodePlan object.
How can I ensure share-mnt
process is configured with the right ``imageRegistryAuthConfig`` , given that all the other processes have the right credentials attached?clever-air-65544
08/26/2022, 3:46 PMnarrow-cpu-6472
08/27/2022, 10:55 AMnarrow-cpu-6472
08/27/2022, 10:56 AMnarrow-cpu-6472
08/27/2022, 11:09 AMnarrow-cpu-6472
08/27/2022, 11:09 AM