creamy-piano-98139
12/15/2022, 5:31 PMsalmon-shoe-87542
12/15/2022, 8:45 PMlittle-actor-95014
12/15/2022, 9:54 PMfew-spoon-45426
12/15/2022, 10:33 PMbest-address-42882
12/15/2022, 10:48 PMgentle-spring-91845
12/16/2022, 10:14 AMINFO[0070] Finding container [service-sidekick] on host [10.155.10.113], try #1
INFO[0070] [sidekick] Sidekick container already created on host [10.155.10.113]
INFO[0070] [healthcheck] Start Healthcheck on service [kubelet] on host [10.155.10.113]
ERRO[0121] Failed to upgrade worker components on NotReady hosts, error: [Failed to verify healthcheck: Failed to check <http://localhost:10248/healthz> for service [kubelet] on host [10.155.10.113]: Get "<http://localhost:10248/healthz>": Unable to access the service on localhost:10248. The service might be still starting up. Error: ssh: rejected: connect failed (Connection refused), log: I1216 09:55:52.876292 1131786 docker_service.go:359] "Docker cri received runtime config" runtimeConfig="&RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:,},}"]
INFO[0121] [controlplane] Now checking status of node 10.155.10.113, try #1
INFO[0126] [controlplane] Now checking status of node 10.155.10.113, try #2
INFO[0131] [controlplane] Now checking status of node 10.155.10.113, try #3
INFO[0136] [controlplane] Now checking status of node 10.155.10.113, try #4
INFO[0141] [controlplane] Now checking status of node 10.155.10.113, try #5
ERRO[0146] Host 10.155.10.113 failed to report Ready status with error: host 10.155.10.113 not ready
INFO[0146] [controlplane] Processing controlplane hosts for upgrade 1 at a time
INFO[0146] Processing controlplane host 10.155.10.113
INFO[0146] [controlplane] Now checking status of node 10.155.10.113, try #1
INFO[0151] [controlplane] Now checking status of node 10.155.10.113, try #2
INFO[0156] [controlplane] Now checking status of node 10.155.10.113, try #3
INFO[0161] [controlplane] Now checking status of node 10.155.10.113, try #4
INFO[0166] [controlplane] Now checking status of node 10.155.10.113, try #5
ERRO[0171] Failed to upgrade hosts: 10.155.10.113 with error [host 10.155.10.113 not ready]
FATA[0171] [controlPlane] Failed to upgrade Control Plane: [[host 10.155.10.113 not ready]]
On master1 I checked the kubelet docker container log
[root@vit81-ldevsa00a ~]# docker logs kubelet --follow --tail 10
--tls-private-key-file string File containing x509 private key matching --tls-cert-file. (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See <https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/> for more information.)
--topology-manager-policy string Topology Manager policy to use. Possible values: 'none', 'best-effort', 'restricted', 'single-numa-node'. (default "none") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See <https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/> for more information.)
--topology-manager-scope string Scope to which topology hints applied. Topology Manager collects hints from Hint Providers and applies them to defined scope to ensure the pod admission. Possible values: 'container', 'pod'. (default "container") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See <https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/> for more information.)
-v, --v Level number for the log level verbosity (default 0)
--version version[=true] Print version information and quit
--vmodule pattern=N,... comma-separated list of pattern=N settings for file-filtered logging (only works for text log format)
--volume-plugin-dir string The full path of the directory in which to search for additional third party volume plugins (default "/usr/libexec/kubernetes/kubelet-plugins/volume/exec/") (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See <https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/> for more information.)
--volume-stats-agg-period duration Specifies interval for kubelet to calculate and cache the volume disk usage for all pods and volumes. To disable volume calculations, set to a negative number. (default 1m0s) (DEPRECATED: This parameter should be set via the config file specified by the Kubelet's --config flag. See <https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/> for more information.)
Error: failed to run Kubelet: unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix: missing address"
[root@vit81-ldevsa00a ~]#
I'm using rke version 1 1.3.10
[root@vit81-ldevsa00a ~]# rke --version
rke version v1.3.10
in the cluster.yaml file I added this line:
authorization:
mode: rbac
options: {}
ignore_docker_version: null
#enable_cri_dockerd: null
enable_cri_dockerd: false
#kubernetes_version: "v1.23.14-rancher1-1"
kubernetes_version: "v1.24.8-rancher1-1" <<<----- THIS LINE ADDED
private_registries: []
ingress:
provider: ""
options: {}
gentle-spring-91845
12/16/2022, 10:52 AMbillions-garden-37463
12/16/2022, 11:33 AMwide-dog-6163
12/16/2022, 1:08 PMacceptable-dream-1782
12/16/2022, 2:23 PMacceptable-printer-7134
12/16/2022, 2:45 PMeks node groups
deletion or creation while they are just imported clusters? we are seeing some weird messages in eks node group section. FYI - we are just importing EKS clusters not creating by rancher. We see node groups creation in EKS that shows rancher trying to create.quaint-book-15301
12/16/2022, 2:58 PMbest-address-42882
12/16/2022, 6:55 PMhttps://raw.githubusercontent.com/haproxytech/helm-charts/main/kubernetes-ingress/chart-icon.png▾
best-address-42882
12/16/2022, 6:56 PMrough-cricket-22538
12/16/2022, 7:50 PMambitious-plastic-3551
12/17/2022, 12:40 PMambitious-plastic-3551
12/17/2022, 12:42 PMbored-farmer-36655
12/17/2022, 1:24 PMkubectl taint nodes node-1 <http://node-role.kubernetes.io/controlplane=true:NoSchedule|node-role.kubernetes.io/controlplane=true:NoSchedule>
would this help: https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/ambitious-plastic-3551
12/17/2022, 1:30 PMambitious-plastic-3551
12/17/2022, 4:20 PMbored-farmer-36655
12/17/2022, 5:08 PMambitious-plastic-3551
12/17/2022, 6:08 PMambitious-plastic-3551
12/17/2022, 6:09 PMcuddly-vegetable-29975
12/18/2022, 7:21 PMbillions-bear-86898
12/19/2022, 3:35 AMlively-night-78214
12/19/2022, 5:14 AMsome-monkey-58167
12/19/2022, 9:18 AMsome-monkey-58167
12/19/2022, 9:19 AMacceptable-printer-7134
12/19/2022, 9:25 AMfew-church-80631
12/19/2022, 10:23 AM