Hi all, running v1.27.7+k3s2 (575bce76),
HA setup with etcd as the datastore (just testing right now with 1 server, 1 agent) but also using tailscale and advertising the address the tailscale address of the server, I have been running into a bunch of 404/403/500 errors coming from various applications (linkerd, argocd, etc), the issue seems to be that ~1% of requests can actually make it to the intended target (e.g. argocd-server to repo-server or linkerd-viz receiving data from prometheus, etc) and the other 99% of the time, its usually a 500 response (reporting: rpc error, tls error or client error).
This issue seems to persist even on a completely fresh k3s install on just a single server and agent.
k3s server systemd config:
ExecStart=/usr/local/bin/k3s \
server \
'--token=' \
'--datastore-endpoint=<http://X.X.X.X.X:2379>' \ (Tailscale domain address for etcd endpoint)
'--advertise-address=100.64.0.X' \ (Tailscale IP for Server)
'--tls-san=100.64.0.0/24'\
Been stuck on this for a while, would appreciate any help in troubleshooting, thanks