This message was deleted.
# k3sa
adamant-kite-43734
09/19/2023, 10:28 AMThis message was deleted.
l
late-needle-80860
09/20/2023, 7:21 AMIs there an actual problem?
s
stale-addition-90512
09/20/2023, 7:22 AMyes, i think api is the bottle neck
stale-addition-90512
09/20/2023, 7:23 AMWaited for 34.031753812s due to client-side throttling, not priority and fairness, request
stale-addition-90512
09/20/2023, 7:24 AMi have tried to set --enable-priority-and-fairness=false, but seem k3s does not respect it
l
late-needle-80860
09/20/2023, 7:25 AMI’ve never had to fiddle with such parameters.
What are requesting of the api when these high waits occur,
s
stale-addition-90512
09/20/2023, 7:26 AMjust restart k3s
c
creamy-pencil-82913
09/20/2023, 5:34 PMWaited for 34.031753812s due to client-side throttlingThat says right there that the Kubernetes client is throttling itself. That is not the apiserver throttling its connection to the database.
creamy-pencil-82913
09/20/2023, 5:34 PMWhat is the client?
s
stale-addition-90512
09/21/2023, 8:06 AMsorry, i don’t know, maybe kubelet inside the k3s? I’ve traced tcp connection during restart, in can only see k3s process is talking to api-server
stale-addition-90512
09/21/2023, 8:06 AM8BMQ363:/usr/share/bcc/tools # ./tcpconnect -P 6443 -t & systemctl restart k3s-server
[1] 8674
Tracing connect ... Hit Ctrl-C to end
TIME(s) PID COMM IP SADDR DADDR DPORT
0.000 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.001 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.003 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.004 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.004 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.004 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.006 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.006 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.008 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.567 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.607 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.607 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.607 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
0.608 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
1.009 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
1.009 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
1.012 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
1.799 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
1.799 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.007 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.009 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.009 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.010 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.010 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.011 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
2.018 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
8BMQ363:/usr/share/bcc/tools # 5.004 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
5.006 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
5.008 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
5.011 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
5.041 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
16.320 9224 k3s-server 4 10.10.202.1 10.10.202.1 6443
stale-addition-90512
09/21/2023, 9:06 AMHi @creamy-pencil-82913 thanks for taking care it here, i saw you also took the ticket in github 😄 , to have more formal communication which can be used by other, i replied it in the ticket, thanks https://github.com/k3s-io/k3s/issues/8396
3 Views