Hello - I'm running a Rancher RKE2 cluster which has rancher-monitoring helm chart installed.
I've installed Loki helm chart but when I try to add it as a Datasource into Grafana (that's been deployed via ranching-monitoring), I always get the error 'Unable to connect with Loki. Please check the server logs for more details.' even though I can explore Loki and see logs in there.
I've confirmed that DNS from the Grafana pod can successfully reach the Loki service.
I've confirmed that Loki service is up and responds to /ready URI
Can anyone suggest other things to check ?
I'm using rancher-monitoring helm version 105.1.1 and loki-stack-2.10.2
Specifically, for speed of testing, I just ran through the instructions on
https://ranchergovernment.com/blog/enhancing-your-rancher-monitoring-experience-with-grafana-loki