https://rancher.com/ logo
Join Slack
Powered by
This message was deleted.
# rke2
a
This message was deleted.
b
There are lot's of layers here obviously but setting up some sort of monitor on the systemd unit might be good.
Having said that, k8s itself keeps pretty good track of things and has properties on the 
nodes
resource that determine if the node is healthy
b
that is true. Thanks for the help!
b
k8s provides mechanisms to ‘watch’ for those changes real time or you can poll every so often
b
Yes ive watched a few in the past. Cool!
b
If you have prometheus or similar running externally and gathering node stats then you could alert with something like grafana/prometheus as well
b
Yes exactly. On this cluster i dont have those tools setup but i should have them setup soon.
b
that would be things like you haven't received a new scrape in a while or even if you have maybe loads on the node are too low (ie: k8s isn't running) and the like
b
thanks for the great info
b
If you want simple stuff running inside to check higher level things you could run something like uptime kuma
b
ah! thats one i havent seen yet. I must go look 😉
b
Maybe put an integration into the cluster to automatically register ingresses with uptime kuma to create/delete monitors automatically
b
Thanks for the tip! this looks like a great tool
b
It's not enterprise-y whatever that means but it's effective as a simple tool
This is relatively popular for monitoring specific services: https://github.com/stakater/IngressMonitorController
b
fantastic!
b
The integrated providers don't work for internal only services which is where kuma would come in
b
ah i see
b
I wish they had a configuration to automate with kuma but alas
b
That would be excellent
b
Maybe someday I’ll get ambitious and just write it myself, but not today :)
Writing a simple controller to do it on your own would be easy enough frankly.
b
Seems like it. I was a developer for 10+ years before i got into ops. I miss writing code.
b
Write ops code!
b
so i plan to remedy that
lol awesome
b
I wrote that. If you're familiar with node red then you will understand the implications and how easily a 'controller’ could be written to automate kuma entries etc
b
that is slick!
b
Internally we do all kinds of crazy stuff with it honestly.
Custom schedulers, admission controllers, etc
b
Sounds like a fun place
👍 1
Ive had my fill of web development - ops development is the only thing i would be interested in doing anymore
Open in Slack
PreviousNext
Powered by