hi I m new to rancher I am trying to deploy an rke2 cluster rancher-users #general

Title

big-jordan-45387

05/14/2023, 7:56 PM

hi, I'm new to rancher, I am trying to deploy an rke2 cluster with cillium cni, rancher keeps

waiting for cluster agent to connect

I am creating a custom cluster. This is the first node with all the roles (etcd, control plane, worker) Any hint?

the status of rancher-system-server is running and I don't see any error

Mai 14 21:45:20 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:45:20+02:00" level=info msg="[Applyinator] Running command: sh [-c rke2 etcd-snapshot list --etcd-s3=false 2>/dev/null]"
Mai 14 21:45:20 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:45:20+02:00" level=info msg="[cb051924b799cb00b8e8a2ec673cb84e68822102ee6e51325010aad48c083afc_0:stdout]: Name Location Size Created"
Mai 14 21:45:20 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:45:20+02:00" level=info msg="[Applyinator] Command sh [-c rke2 etcd-snapshot list --etcd-s3=false 2>/dev/null] finished with err: <nil> and exit code: 0"
Mai 14 21:55:21 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:55:21+02:00" level=info msg="[Applyinator] No image provided, creating empty working directory /var/lib/rancher/agent/work/20230514-215521/cb051924b799cb00b8e8a2ec673cb84e68822102ee6e51325010aad48c083afc_0"
Mai 14 21:55:21 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:55:21+02:00" level=info msg="[Applyinator] Running command: sh [-c rke2 etcd-snapshot list --etcd-s3=false 2>/dev/null]"
Mai 14 21:55:21 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:55:21+02:00" level=info msg="[cb051924b799cb00b8e8a2ec673cb84e68822102ee6e51325010aad48c083afc_0:stdout]: Name Location Size Created"
Mai 14 21:55:21 nid003220 rancher-system-agent[43348]: time="2023-05-14T21:55:21+02:00" level=info msg="[Applyinator] Command sh [-c rke2 etcd-snapshot list --etcd-s3=false 2>/dev/null] finished with err: <nil> and exit code: 0"

This is what I can see in the rke2-server logs

Mai 14 22:02:14 nid003220 rke2[45051]: time="2023-05-14T22:02:14+02:00" level=error msg="Failed to get recorded learner progress from etcd: context deadline exceeded"
Mai 14 22:02:16 nid003220 rke2[45051]: time="2023-05-14T22:02:16+02:00" level=error msg="Failed to connect to proxy. Empty dialer response" error="dial tcp 148.187.114.187:9345: connect: no route to host"
Mai 14 22:02:16 nid003220 rke2[45051]: time="2023-05-14T22:02:16+02:00" level=error msg="Remotedialer proxy error" error="dial tcp 148.187.114.187:9345: connect: no route to host"
Mai 14 22:02:21 nid003220 rke2[45051]: time="2023-05-14T22:02:21+02:00" level=info msg="Connecting to proxy" url="<wss://148.187.114.187:9345/v1-rke2/connect>"
Mai 14 22:02:22 nid003220 rke2[45051]: {"level":"warn","ts":"2023-05-14T22:02:22.449+0200","logger":"etcd-client","caller":"v3@v3.5.4-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed">
Mai 14 22:02:22 nid003220 rke2[45051]: {"level":"info","ts":"2023-05-14T22:02:22.449+0200","logger":"etcd-client","caller":"v3@v3.5.4-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"conte>
Mai 14 22:02:24 nid003220 rke2[45051]: time="2023-05-14T22:02:24+02:00" level=error msg="Failed to connect to proxy. Empty dialer response" error="dial tcp 148.187.114.187:9345: connect: no route to host"
Mai 14 22:02:24 nid003220 rke2[45051]: time="2023-05-14T22:02:24+02:00" level=error msg="Remotedialer proxy error" error="dial tcp 148.187.114.187:9345: connect: no route to host"
Mai 14 22:02:29 nid003220 rke2[45051]: {"level":"warn","ts":"2023-05-14T22:02:29.140+0200","logger":"etcd-client","caller":"v3@v3.5.4-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed">
Mai 14 22:02:29 nid003220 rke2[45051]: time="2023-05-14T22:02:29+02:00" level=error msg="Failed to get recorded learner progress from etcd: context deadline exceeded"
Mai 14 22:02:29 nid003220 rke2[45051]: time="2023-05-14T22:02:29+02:00" level=info msg="Connecting to proxy" url="<wss://148.187.114.187:9345/v1-rke2/connect>"

I can see rke2 service up and listening on port `9345`:

nid003220:~ # ss -nolpt | grep 9345
LISTEN   0         128                        *:9345                   *:*       users:(("rke2",pid=45051,fd=8))

I can confirm I am getting an error when accessing the websocket

nid003220:~ # ./websocat -k <wss://148.187.114.187:9345/v1-rke2/connect>
websocat: WebSocketError: I/O failure
websocat: error running

Using localhost gives a

forbbiden

error

nid003220:~ # ./websocat -k <wss://127.0.0.1:9345/v1-rke2/connect>
websocat: WebSocketError: WebSocketError: Received unexpected status code (403 Forbidden)
websocat: error running

by the way, rke2 version is

v1.24.13+rke2r1

13 Views

#general Join Slack