curved-caravan-26314
06/21/2022, 8:17 PMNAMESPACE NAME READY STATUS RESTARTS AGE
cert-manager cert-manager-76d44b459c-qfdgq 1/1 Running 0 4m26s
cert-manager cert-manager-cainjector-9b679cc6-rnzcc 1/1 Running 0 4m26s
cert-manager cert-manager-webhook-57c994b6b9-r7cxs 1/1 Running 0 4m26s
kube-system cloud-controller-manager-rke2 1/1 Running 0 18m
kube-system etcd-rke2 1/1 Running 0 17m
kube-system helm-install-rke2-canal-zvs8x 0/1 Completed 0 17m
kube-system helm-install-rke2-coredns-frgcz 0/1 Completed 0 17m
kube-system helm-install-rke2-ingress-nginx-8mvg9 0/1 Completed 0 17m
kube-system helm-install-rke2-metrics-server-rp2jz 0/1 Completed 0 17m
kube-system kube-apiserver-rke2 1/1 Running 0 17m
kube-system kube-controller-manager-rke2 1/1 Running 0 18m
kube-system kube-proxy-rke2 1/1 Running 0 18m
kube-system kube-scheduler-rke2 1/1 Running 0 18m
kube-system rke2-canal-nkrmd 2/2 Running 0 16m
kube-system rke2-coredns-rke2-coredns-547d5499cb-4g4jj 1/1 Running 0 16m
kube-system rke2-coredns-rke2-coredns-autoscaler-65c9bb465d-m2d8d 1/1 Running 0 16m
kube-system rke2-ingress-nginx-controller-s977x 1/1 Running 0 11m
kube-system rke2-metrics-server-6564db4569-9h8mk 1/1 Running 0 13m
hundreds-evening-84071
06/21/2022, 8:22 PMkubectl get nodes
curved-caravan-26314
06/21/2022, 8:23 PMroot@rke2:/home/ilook# kubectl get nodes
NAME STATUS ROLES AGE VERSION
rke2 Ready control-plane,etcd,master 25m v1.23.7+rke2r2
hundreds-evening-84071
06/21/2022, 8:24 PMcurved-caravan-26314
06/21/2022, 8:25 PMhundreds-evening-84071
06/21/2022, 8:31 PMcontrolplane=:NoSchedule
and
etcd=:NoExecute
curved-caravan-26314
06/21/2022, 8:31 PMrapid-helmet-86074
06/21/2022, 9:06 PMcurved-caravan-26314
06/21/2022, 9:25 PMrapid-helmet-86074
06/21/2022, 9:25 PMcurved-caravan-26314
06/21/2022, 9:29 PMName: rancher-7bbd98588-2mqtg
Namespace: cattle-system
Priority: 0
Node: rke2/192.168.1.145
Start Time: Tue, 21 Jun 2022 15:24:25 -0500
Labels: app=rancher
pod-template-hash=7bbd98588
release=rancher
Annotations: <http://cni.projectcalico.org/containerID|cni.projectcalico.org/containerID>: 5b44982cc7f3302fc3a4623c2d2dad03476363e33cb9600aadc51ca3cfe521fa
<http://cni.projectcalico.org/podIP|cni.projectcalico.org/podIP>: 10.42.0.14/32
<http://cni.projectcalico.org/podIPs|cni.projectcalico.org/podIPs>: 10.42.0.14/32
<http://kubernetes.io/psp|kubernetes.io/psp>: global-unrestricted-psp
Status: Running
IP: 10.42.0.14
IPs:
IP: 10.42.0.14
Controlled By: ReplicaSet/rancher-7bbd98588
Containers:
rancher:
Container ID: <containerd://65256afbc4ed446301dff1488f7c3f291b6aa88bcd2035ca8d828df9b01f44a>6
Image: rancher/rancher:v2.6.5
Image ID: <http://docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4|docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4>
Port: 80/TCP
Host Port: 0/TCP
Args:
--no-cacerts
--http-listen-port=80
--https-listen-port=443
--add-local=true
State: Running
Started: Tue, 21 Jun 2022 15:30:30 -0500
Ready: True
Restart Count: 0
Liveness: http-get http://:80/healthz delay=60s timeout=1s period=30s #success=1 #failure=3
Readiness: http-get http://:80/healthz delay=5s timeout=1s period=30s #success=1 #failure=3
Environment:
CATTLE_NAMESPACE: cattle-system
CATTLE_PEER_SERVICE: rancher
CATTLE_BOOTSTRAP_PASSWORD: <set to the key 'bootstrapPassword' in secret 'bootstrap-secret'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-2rwsm (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-2rwsm:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: <http://cattle.io/os=linux:NoSchedule|cattle.io/os=linux:NoSchedule>
<http://node.kubernetes.io/not-ready:NoExecute|node.kubernetes.io/not-ready:NoExecute> op=Exists for 300s
<http://node.kubernetes.io/unreachable:NoExecute|node.kubernetes.io/unreachable:NoExecute> op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 35m default-scheduler Successfully assigned cattle-system/rancher-7bbd98588-2mqtg to rke2
Normal Pulling 35m kubelet Pulling image "rancher/rancher:v2.6.5"
Normal Pulled 29m kubelet Successfully pulled image "rancher/rancher:v2.6.5" in 6m0.181711241s
Normal Created 29m kubelet Created container rancher
Normal Started 29m kubelet Started container rancher
Warning Unhealthy 27m (x4 over 28m) kubelet Readiness probe failed: Get "<http://10.42.0.14:80/healthz>": dial tcp 10.42.0.14:80: connect: connection refused
Name: rancher-7bbd98588-hm495
Namespace: cattle-system
Priority: 0
Node: rke2/192.168.1.145
Start Time: Tue, 21 Jun 2022 15:24:25 -0500
Labels: app=rancher
pod-template-hash=7bbd98588
release=rancher
Annotations: <http://cni.projectcalico.org/containerID|cni.projectcalico.org/containerID>: fc821cf9e33787b6ba55ed7e7124d3194399ac1f419a56eb359cfd36027c320f
<http://cni.projectcalico.org/podIP|cni.projectcalico.org/podIP>: 10.42.0.15/32
<http://cni.projectcalico.org/podIPs|cni.projectcalico.org/podIPs>: 10.42.0.15/32
<http://kubernetes.io/psp|kubernetes.io/psp>: global-unrestricted-psp
Status: Running
IP: 10.42.0.15
IPs:
IP: 10.42.0.15
Controlled By: ReplicaSet/rancher-7bbd98588
Containers:
rancher:
Container ID: <containerd://f66b5e2765a33f9e04b8d9324644a4ae2ff4106f98207b571bc67866b3d3823>1
Image: rancher/rancher:v2.6.5
Image ID: <http://docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4|docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4>
Port: 80/TCP
Host Port: 0/TCP
Args:
--no-cacerts
--http-listen-port=80
--https-listen-port=443
--add-local=true
State: Running
Started: Tue, 21 Jun 2022 15:30:29 -0500
Ready: True
Restart Count: 0
Liveness: http-get http://:80/healthz delay=60s timeout=1s period=30s #success=1 #failure=3
Readiness: http-get http://:80/healthz delay=5s timeout=1s period=30s #success=1 #failure=3
Environment:
CATTLE_NAMESPACE: cattle-system
CATTLE_PEER_SERVICE: rancher
CATTLE_BOOTSTRAP_PASSWORD: <set to the key 'bootstrapPassword' in secret 'bootstrap-secret'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wgcvc (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-wgcvc:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: <http://cattle.io/os=linux:NoSchedule|cattle.io/os=linux:NoSchedule>
<http://node.kubernetes.io/not-ready:NoExecute|node.kubernetes.io/not-ready:NoExecute> op=Exists for 300s
<http://node.kubernetes.io/unreachable:NoExecute|node.kubernetes.io/unreachable:NoExecute> op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 35m default-scheduler Successfully assigned cattle-system/rancher-7bbd98588-hm495 to rke2
Normal Pulling 35m kubelet Pulling image "rancher/rancher:v2.6.5"
Normal Pulled 29m kubelet Successfully pulled image "rancher/rancher:v2.6.5" in 5m59.329193041s
Normal Created 29m kubelet Created container rancher
Normal Started 29m kubelet Started container rancher
Warning Unhealthy 27m (x4 over 28m) kubelet Readiness probe failed: Get "<http://10.42.0.15:80/healthz>": dial tcp 10.42.0.15:80: connect: connection refused
Name: rancher-7bbd98588-q5h2f
Namespace: cattle-system
Priority: 0
Node: rke2/192.168.1.145
Start Time: Tue, 21 Jun 2022 15:24:25 -0500
Labels: app=rancher
pod-template-hash=7bbd98588
release=rancher
Annotations: <http://cni.projectcalico.org/containerID|cni.projectcalico.org/containerID>: cd3206f99bd04b1a5d65faa07d8e111877dda5e2b3a9eaac9f0fd2bc7a9449f5
<http://cni.projectcalico.org/podIP|cni.projectcalico.org/podIP>: 10.42.0.13/32
<http://cni.projectcalico.org/podIPs|cni.projectcalico.org/podIPs>: 10.42.0.13/32
<http://kubernetes.io/psp|kubernetes.io/psp>: global-unrestricted-psp
Status: Running
IP: 10.42.0.13
IPs:
IP: 10.42.0.13
Controlled By: ReplicaSet/rancher-7bbd98588
Containers:
rancher:
Container ID: <containerd://ff8feaa172c83c159f1094906c3d060b9b395960e354f7ceb986b3f86fd6629>1
Image: rancher/rancher:v2.6.5
Image ID: <http://docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4|docker.io/rancher/rancher@sha256:ae5135c25b2141bb2aac8a03a9afd77e845f36b9a6c000377c858233aae355d4>
Port: 80/TCP
Host Port: 0/TCP
Args:
--no-cacerts
--http-listen-port=80
--https-listen-port=443
--add-local=true
State: Running
Started: Tue, 21 Jun 2022 15:32:15 -0500
Last State: Terminated
Reason: Error
Exit Code: 1
Started: Tue, 21 Jun 2022 15:30:47 -0500
Finished: Tue, 21 Jun 2022 15:31:53 -0500
Ready: True
Restart Count: 2
Liveness: http-get http://:80/healthz delay=60s timeout=1s period=30s #success=1 #failure=3
Readiness: http-get http://:80/healthz delay=5s timeout=1s period=30s #success=1 #failure=3
Environment:
CATTLE_NAMESPACE: cattle-system
CATTLE_PEER_SERVICE: rancher
CATTLE_BOOTSTRAP_PASSWORD: <set to the key 'bootstrapPassword' in secret 'bootstrap-secret'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5ws94 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-5ws94:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: <http://cattle.io/os=linux:NoSchedule|cattle.io/os=linux:NoSchedule>
<http://node.kubernetes.io/not-ready:NoExecute|node.kubernetes.io/not-ready:NoExecute> op=Exists for 300s
<http://node.kubernetes.io/unreachable:NoExecute|node.kubernetes.io/unreachable:NoExecute> op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 35m default-scheduler Successfully assigned cattle-system/rancher-7bbd98588-q5h2f to rke2
Normal Pulling 35m kubelet Pulling image "rancher/rancher:v2.6.5"
Normal Pulled 29m kubelet Successfully pulled image "rancher/rancher:v2.6.5" in 5m59.832370366s
Warning Unhealthy 27m kubelet Liveness probe failed: Get "<http://10.42.0.13:80/healthz>": dial tcp 10.42.0.13:80: connect: connection refused
Normal Pulled 27m (x2 over 28m) kubelet Container image "rancher/rancher:v2.6.5" already present on machine
Normal Created 27m (x3 over 29m) kubelet Created container rancher
Normal Started 27m (x3 over 29m) kubelet Started container rancher
Warning Unhealthy 27m (x6 over 28m) kubelet Readiness probe failed: Get "<http://10.42.0.13:80/healthz>": dial tcp 10.42.0.13:80: connect: connection refused
rapid-helmet-86074
06/21/2022, 9:39 PMcurved-caravan-26314
06/21/2022, 9:43 PMrapid-helmet-86074
06/21/2022, 9:44 PMkubectl edit deployment rancher -n cattle-system
or something very similar is how you do the editing itself.hundreds-evening-84071
06/21/2022, 10:16 PMkubectl get all -n cattle-system
also, if you have networking weirdness going on then that will cause issues. best to look at network requirements and resolvefaint-airport-83518
06/22/2022, 5:46 PMrke2-init.sh
is the main script