This message was deleted.
# generala
adamant-kite-43734
02/07/2024, 2:19 PMThis message was deleted.
a
adorable-train-88202
02/07/2024, 4:38 PMI was doing it manually but then found this thread which was a much cleaner approach (this is assuming kubernetes is actually working) -> https://www.reddit.com/r/rancher/comments/18yf8bn/regarding_rke2_etcd_health_check/
adorable-train-88202
02/07/2024, 4:39 PMpretty much from kubectl running from the cluster, run the following
for etcdpod in $(kubectl -n kube-system get pod -l component=etcd --no-headers -o custom-columns=NAME:.metadata.name); do kubectl -n kube-system exec $etcdpod -- sh -c "ETCDCTL_ENDPOINTS='<https://127.0.0.1:2379>' ETCDCTL_CACERT='/var/lib/rancher/rke2/server/tls/etcd/server-ca.crt' ETCDCTL_CERT='/var/lib/rancher/rke2/server/tls/etcd/server-client.crt' ETCDCTL_KEY='/var/lib/rancher/rke2/server/tls/etcd/server-client.key' ETCDCTL_API=3 etcdctl endpoint status"; doneadorable-train-88202
02/07/2024, 4:41 PMpretty elegant, will execute the etcdctl command in each pod to get the status/health which tells you who is the leader
adorable-train-88202
02/07/2024, 4:42 PMwell sort of, might have to add another echo in the while loop so you can see which pod has the output
adorable-train-88202
02/07/2024, 4:44 PMlike this:
Copy code
for etcdpod in $(kubectl -n kube-system get pod -l component=etcd --no-headers -o custom-columns=NAME:.metadata.name); do echo $etcdpod; kubectl -n kube-system exec $etcdpod -- sh -c "ETCDCTL_ENDPOINTS='<https://127.0.0.1:2379>' ETCDCTL_CACERT='/var/lib/rancher/rke2/server/tls/etcd/server-ca.crt' ETCDCTL_CERT='/var/lib/rancher/rke2/server/tls/etcd/server-client.crt' ETCDCTL_KEY='/var/lib/rancher/rke2/server/tls/etcd/server-client.key' ETCDCTL_API=3 etcdctl endpoint status"; done🏅 1
adorable-train-88202
02/07/2024, 4:44 PMall credit to the person from that post
c
calm-rainbow-75708
02/07/2024, 6:12 PMWouaa cool. May I ask a subsidary question. If the leader server disappear, will K3s elect a new leader automatically ?
calm-rainbow-75708
02/07/2024, 6:16 PMI will test out so I'll get my answer 🙂
calm-rainbow-75708
02/07/2024, 6:18 PM@adorable-train-88202 Thanks a lot, I will test this, I think I don't have any etcd pod running in my k3S
calm-rainbow-75708
02/07/2024, 6:33 PMI don't know if this is because I am using the Embedded etcd for K3s
calm-rainbow-75708
02/07/2024, 6:37 PMFound it, using etcdctl on the host
calm-rainbow-75708
02/07/2024, 6:37 PM Copy code
ETCDCTL_API=3 etcdctl --cacert=/scratchK3s/k3s/data/server/tls/etcd/server-ca.crt --cert=/scratchK3s/k3s/data/server/tls/etcd/client.crt --key=/scratchK3s/k3s/data/server/tls/etcd/client.key endpoint health --cluster --write-out=table
+----------------------------+--------+------------+-------+
| ENDPOINT | HEALTH | TOOK | ERROR |
+----------------------------+--------+------------+-------+
| <https://10.46.232.141:2379> | true | 2.464256ms | |
+----------------------------+--------+------------+-------+a
adorable-train-88202
02/07/2024, 7:21 PMah nice, yeah I'm not too sure how that even looks like for K3s but the idea seemed the same
adorable-train-88202
02/07/2024, 7:21 PMyou try endpoint status vs endpoint health?
p
prehistoric-soccer-87998
02/07/2024, 11:23 PMFrom your point i think i should look at "endpoint status"
18 Views