Oct 03 13:06:11 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:11+02:00" level=info msg="Waiting for containerd startup: rpc error: code = Unknown desc = server is not initialized yet"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="containerd is now running"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/cloud-controller-manager-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/cloud-controller-manager-image.txt in 7.450011ms"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/etcd-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/etcd-image.txt in 1.954532ms"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/kube-apiserver-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/kube-apiserver-image.txt in 693.204µs"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/kube-controller-manager-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/kube-controller-manager-image.txt in 1.720096ms"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/kube-proxy-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/kube-proxy-image.txt in 4.315543ms"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Pulling images from /var/lib/rancher/rke2/agent/images/kube-scheduler-image.txt"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Imported images from /var/lib/rancher/rke2/agent/images/kube-scheduler-image.txt in 1.366165ms"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Running kubelet --address=0.0.0.0 --alsologtostderr=false --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=systemd --client-ca-file=/var/lib/rancher/rke2/agent/client-ca.crt --cloud-provider=external --cluster-dns=10.43.0.10 --cluster-domain=cluster.local --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=127.0.0.1 --hostname-override=<http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> --kubeconfig=/var/lib/rancher/rke2/agent/kubelet.kubeconfig --log-file=/var/lib/rancher/rke2/agent/logs/kubelet.log --log-file-max-size=50 --logtostderr=false --node-labels= --pod-infra-container-image=<http://index.docker.io/rancher/pause:3.6|index.docker.io/rancher/pause:3.6> --pod-manifest-path=/var/lib/rancher/rke2/agent/pod-manifests --read-only-port=0 --resolv-conf=/etc/resolv.conf --serialize-image-pulls=false --stderrthreshold=FATAL --tls-cert-file=/var/lib/rancher/rke2/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/rke2/agent/serving-kubelet.key"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Connecting to proxy" url="<wss://127.0.0.1:9345/v1-rke2/connect>"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Handling backend connection request [<http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de>]"
Oct 03 13:06:12 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:12+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:18 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:18+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:22 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:22.657+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:22 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"info","ts":"2023-10-03T13:06:22.659+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"context deadline exceeded"}
Oct 03 13:06:23 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:23+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:28 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:28+02:00" level=info msg="Container for etcd not found (no matching container found), retrying"
Oct 03 13:06:28 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:28+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:33 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:33+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:37 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:37.664+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:37 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:37+02:00" level=info msg="Failed to test data store connection: context deadline exceeded"
Oct 03 13:06:37 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:37.720+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:37 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"info","ts":"2023-10-03T13:06:37.720+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"context deadline exceeded"}
Oct 03 13:06:38 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:38+02:00" level=info msg="Waiting for API server to become available"
Oct 03 13:06:38 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:38+02:00" level=info msg="Waiting for etcd server to become available"
Oct 03 13:06:38 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:38+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:42 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:42.508+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:42 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:42+02:00" level=error msg="Failed to check local etcd status for learner management: context deadline exceeded"
Oct 03 13:06:43 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:43+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:48 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:48+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:48 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:48+02:00" level=info msg="Container for etcd not found (no matching container found), retrying"
Oct 03 13:06:52 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:52.748+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:52 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"info","ts":"2023-10-03T13:06:52.749+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"context deadline exceeded"}
Oct 03 13:06:53 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:53+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:06:57 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: {"level":"warn","ts":"2023-10-03T13:06:57.509+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"<etcd-endpoints://0xc0004f3500/127.0.0.1:2379>","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""}
Oct 03 13:06:57 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:57+02:00" level=error msg="Failed to check local etcd status for learner management: context deadline exceeded"
Oct 03 13:06:58 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:06:58+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"
Oct 03 13:07:03 <http://rancher01a.ac.aixigo.de|rancher01a.ac.aixigo.de> rke2[901]: time="2023-10-03T13:07:03+02:00" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: <https://127.0.0.1:9345/v1-rke2/readyz>: 500 Internal Server Error"