Channels
academy
amazon
arm
azure
cabpr
chinese
ci-cd
danish
deutsch
developer
elemental
epinio
espanol
events
extensions
fleet
français
gcp
general
harvester
harvester-dev
hobbyfarm
hypper
japanese
k3d
k3os
k3s
k3s-contributor
kim
kubernetes
kubewarden
lima
logging
longhorn-dev
longhorn-storage
masterclass
mesos
mexico
nederlands
neuvector-security
office-hours
one-point-x
onlinemeetup
onlinetraining
opni
os
ozt
phillydotnet
portugues
rancher-desktop
rancher-extensions
rancher-setup
rancher-wrangler
random
rfed_ara
rio
rke
rke2
russian
s3gw
service-mesh
storage
submariner
supermicro-sixsq
swarm
terraform-controller
terraform-provider-rancher2
terraform-provider-rke
theranchcast
training-0110
training-0124
training-0131
training-0207
training-0214
training-1220
ukranian
v16-v21-migration
vsphere
windows
Title
m
many-area-51777
08/31/2022, 12:19 PMHey, just upgrade to 2.6.8 and rancher is not coming up anymore. First I had to extend the liveness settings as mentioned in https://github.com/rancher/rancher/issues/38177 but even though the logs show that something is happening, at the end the pod dies and tries to restart.
nauthorized
W0903 22:11:23.709526 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:23.709553 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
W0903 22:11:23.726334 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:23.726360 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
2022/09/03 22:11:24 [ERROR] failed to call leader func: failed to add management data: Unauthorized
2022/09/03 22:11:24 [ERROR] failed to call leader func: Unauthorized
W0903 22:11:24.358226 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:24.358258 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
I0903 22:11:24.474577 32 leaderelection.go:283] failed to renew lease kube-system/cattle-controllers: timed out waiting for the condition
E0903 22:11:24.474647 32 leaderelection.go:306] Failed to release lock: resource name may not be empty
2022/09/03 22:11:24 [FATAL] leaderelection lost for cattle-controllers
Started seeing these after 2.6.8 upgrade:
nauthorized
W0903 22:11:23.709526 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:23.709553 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
W0903 22:11:23.726334 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:23.726360 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
2022/09/03 22:11:24 [ERROR] failed to call leader func: failed to add management data: Unauthorized
2022/09/03 22:11:24 [ERROR] failed to call leader func: Unauthorized
W0903 22:11:24.358226 32 reflector.go:325] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: failed to list *summary.SummarizedObject: Unauthorized
E0903 22:11:24.358258 32 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.24.0-rancher1/tools/cache/reflector.go:168: Failed to watch *summary.SummarizedObject: failed to list *summary.SummarizedObject: Unauthorized
I0903 22:11:24.474577 32 leaderelection.go:283] failed to renew lease kube-system/cattle-controllers: timed out waiting for the condition
E0903 22:11:24.474647 32 leaderelection.go:306] Failed to release lock: resource name may not be empty
2022/09/03 22:11:24 [FATAL] leaderelection lost for cattle-controllersAny known solution for that? I can't start rancher pod anymore.