This message was deleted.

check the containerd logs to see what the actual error is. containerd will always fall back to trying the default endpoint if it can’t pull from your mirror endpoint, and if it does that then the error from your mirror doesnt’ show up in the kubelet due to how the fallback is handled within containerd.

interestingly enough I cannot find any log files in /var/log/pods/cattle-system_cattle-cluster-agent... But I see your point, it looks like I only have v2.7.6 image not v2.7.9 on my harbor instance. I'd bet that is the problem, thanks for the assistance brandon you're a legend

no, the containerd logs

I see, my mistake. It appears I am correct im simply getting a 404 from harbor due to the wrong version then rke2 is going onto the next registry. I see where I got confused. Thanks for the clarification and now I know the containerd logs are more useful than just describing the pod 😅

ah, so you don’t have the v2.7.9 tag pushed to your mirror?

yeah... I'm smacking my forehead as we speak

that would certainly do it