This message was deleted.

Since you have kubectl working, take a look at pod logs in

cattle-system

namespace

time="2025-01-23T00:00:58Z" level=warning msg="[2] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[13] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[11] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[12] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[14] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[3] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[5] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[6] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[8] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[10] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[4] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[7] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[9] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"tunnel disconnect\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[13] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37670->10.29.128.1:443: read tcp 10.29.0.164:37670->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[6] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37492->10.29.128.1:443: read tcp 10.29.0.164:37492->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[4] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37478->10.29.128.1:443: read tcp 10.29.0.164:37478->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[10] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37654->10.29.128.1:443: read tcp 10.29.0.164:37654->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[11] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37658->10.29.128.1:443: read tcp 10.29.0.164:37658->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[14] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:35714->10.29.128.1:443: read tcp 10.29.0.164:35714->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[7] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37498->10.29.128.1:443: read tcp 10.29.0.164:37498->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[9] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37526->10.29.128.1:443: read tcp 10.29.0.164:37526->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[12] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37666->10.29.128.1:443: read tcp 10.29.0.164:37666->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[3] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37472->10.29.128.1:443: read tcp 10.29.0.164:37472->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[8] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37514->10.29.128.1:443: read tcp 10.29.0.164:37514->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=error msg="Remotedialer proxy error" error="read tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:00:58Z" level=warning msg="[2] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37464->10.29.128.1:443: read tcp 10.29.0.164:37464->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:00:58Z" level=warning msg="[5] encountered error \"write tcp 10.29.0.164:49810->10.23.82.149:443: i/o timeout\" while writing error \"writeto tcp 10.29.0.164:37488->10.29.128.1:443: read tcp 10.29.0.164:37488->10.29.128.1:443: use of closed network connection\" to close remotedialer"
time="2025-01-23T00:01:00Z" level=error msg="Failed to dial steve aggregation server: read tcp 10.29.0.164:49830->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:01:08Z" level=info msg="Connecting to <wss://hub-rancherprd.x.x.x/v3/connect> with token starting with r68fkldxms4gct2b758h8rrzhrv"
time="2025-01-23T00:01:08Z" level=info msg="Connecting to proxy" url="<wss://hub-rancherprd.x.x.x/v3/connect>"
time="2025-01-23T00:01:10Z" level=error msg="Failed to dial steve aggregation server: read tcp 10.29.0.164:37278->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:01:18Z" level=error msg="Failed to connect to proxy. Empty dialer response" error="read tcp 10.29.0.164:56238->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:01:18Z" level=error msg="Remotedialer proxy error" error="read tcp 10.29.0.164:56238->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:01:20Z" level=error msg="Failed to dial steve aggregation server: read tcp 10.29.0.164:56246->10.23.82.149:443: i/o timeout"
time="2025-01-23T00:01:28Z" level=info msg="Connecting to <wss://hub-rancherprd.x.x.x/v3/connect> with token starting with r68fkldxms4gct2b758h8rrzhrv"
time="2025-01-23T00:01:28Z" level=info msg="Connecting to proxy" url="<wss://hub-rancherprd.x.x.x/v3/connect>"
time="2025-01-23T00:08:45Z" level=info msg="[systemcharts] feature ManagedSystemUpgradeController = false, toEnable = true"
time="2025-01-23T01:08:46Z" level=info msg="[systemcharts] feature ManagedSystemUpgradeController = false, toEnable = true"
time="2025-01-23T01:08:46Z" level=info msg="[systemcharts] feature ManagedSystemUpgradeController = false, toEnable = true"

Why is it keep looking for rancher IP instead of domain name

10.23.82.149

This is rancher IP but we run docker compose with port 8443 and domain hub-rancherprd.x.x.x on port 443 which terminates the SSL and in Rancher server URL set the domain name instead of IP