Hi all I ve been a long time k3s user I m trying to standup rancher-users #k3s

Title

proud-plumber-22060

08/03/2022, 4:27 PM

Hi all.. I've been a long time k3s user. I'm trying to standup a new k3s single node cluster on Digital Ocean. I have an older 1.18 install that's worked fine but it needs to be upgraded. I haven't been able to get k3s it work really at all, on both debian, ubuntu, and coreos. I will have basic issues with

kubectl get nodes

it will just timeout. At times I can't even install the k8s example nginx app. I've installed k3s via the standard k3s install script, no options set.

sudo k3s check-config

passes, there's a two missing modules. The logs are loaded with errors of slow sql and errors like this

: Get \"<https://127.0.0.1:6443/api/v1/nodes/ubuntu-s-1vcpu-1gb-sfo3-01?timeout=10s>\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"

and many other endpoints.

Aug  3 16:33:07 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:07.662744    6772 writers.go:118] apiserver was unable to write a JSON response: http: Handle
r timeout
Aug  3 16:33:07 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:07.665058    6772 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
Aug  3 16:33:07 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:07.672117    6772 writers.go:131] apiserver was unable to write a fallback JSON response: http: Handler timeout
Aug  3 16:33:07 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:07.701400    6772 kubelet.go:2010] "Skipping pod synchronization" err="[container runtime is down, PLEG is not healthy: pleg was last seen active 3m43.674150695s ago; threshold is 3m0s]"
Aug  3 16:33:07 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:07.830830    6772 controller.go:144] failed to ensure lease exists, will retry in 400ms, error: Get "<https://127.0.0.1:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ubuntu-s-1vcpu-1gb-sfo3-01?timeout=10s>": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:08.256865    6772 writers.go:131] apiserver was unable to write a fallback JSON response: http: Handler timeout
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: time="2022-08-03T16:33:08Z" level=error msg="error while range on /registry/events/ /registry/events/: context canceled"
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:08.461604    6772 timeout.go:141] post-timeout activity - time-elapsed: 12.146971637s, GET "/apis/cert-manager.io/v1/certificates" result: <nil>
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:08.571575    6772 writers.go:131] apiserver was unable to write a fallback JSON response: http: Handler timeout
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: W0803 16:33:08.771719    6772 controller.go:134] slow openapi aggregation of "<http://ingressrouteudps.traefik.containo.us|ingressrouteudps.traefik.containo.us>": 3m15.599036263s
Aug  3 16:33:08 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:08.802992    6772 handler.go:170] "Error writing response" err="client disconnected"
Aug  3 16:33:10 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: I0803 16:33:08.822586    6772 log.go:195] http: TLS handshake error from 10.42.0.3:35692: EOF
Aug  3 16:33:11 ubuntu-s-1vcpu-1gb-sfo3-01 k3s[6772]: E0803 16:33:10.995776    6772 server.go:274] "Unable to authenticate the request due to an error" err="context canceled"

just deleted and tried installing with k3sup, same issue on debian too. Crazy timeouts on everything

9 Views

#k3s Join Slack