ancient-energy-15842
08/30/2022, 11:31 PM[ERROR] error syncing '_all_': handler user-controllers-controller: failed to start user controllers for cluster c-4p8gk: ClusterUnavailable 503: cluster not found, failed to start user controllers for cluster c-qgw7q: ClusterUnavailable 503: cluster not found, requeuing
ancient-energy-15842
08/30/2022, 11:31 PMlittle-accountant-66169
08/31/2022, 12:28 AMlittle-accountant-66169
08/31/2022, 12:29 AMtime="2022-08-31T09:23:43+09:00" level=fatal msg="cannot access containerd socket \"\\\\\\\\.\\\\pipe\\\\containerd-containerd\": open \\\\.\\pipe\\containerd-containerd: The system cannot find the file specified."
big-architect-39828
08/31/2022, 1:44 AMbig-architect-39828
08/31/2022, 1:44 AMquiet-insurance-89872
08/31/2022, 2:30 AMquiet-football-25667
08/31/2022, 3:36 AMstale-dinner-99388
08/31/2022, 5:47 AMbright-whale-83501
08/31/2022, 7:18 AMechoing-animal-32877
08/31/2022, 9:18 AMchilly-caravan-31853
08/31/2022, 10:30 AMwitty-balloon-26464
08/31/2022, 10:38 AMwitty-balloon-26464
08/31/2022, 10:44 AMthankful-area-70093
08/31/2022, 11:28 AMdocker run -d --name=rancher --restart=unless-stopped -p 80:80 -p 443:443 -v /root/rancher:/var/lib/rancher --privileged rancher/rancher:v2.5.5 --acme-domain <http://rancher.xxx|rancher.xxx>
. I wanted to connect to the docker rancher/rancher container, but there is none. Only rancher/rancher-agent exists on my worker nodes, but on my master node there is only rancher/hyperkube:v1.19.6 etc. I have read through all of these github issues, but cannot get it solved.curved-baker-5639
08/31/2022, 12:08 PMRancher faced an issue (CONFLICT) during the deployment of server: [...] info: an <http://apps.catalog.cattle.io|apps.catalog.cattle.io> already exists with ID [...] in namespace [...]"}
I think the bit up to “info” comes from their code, so it’s just expressing a 409 I guess. I checked the app.catalog.cattle.io crd and it exists. What’s interesting is when I visit v3/project/[project]/apps
I see a list of apps, but when they try to upgrade one, they get that error and the app disappears from that listmany-area-51777
08/31/2022, 12:19 PMwitty-balloon-26464
08/31/2022, 3:30 PMbrash-monitor-41966
08/31/2022, 4:27 PMbrash-monitor-41966
08/31/2022, 4:29 PMbest-oil-69865
08/31/2022, 6:04 PMcurrent-db-size":"11 MB","current-db-size-in-use-bytes":11010048,"current-db-size-in-use":"11 MB"}
{"level":"info","ts":"2022-08-31T18:03:31.302Z","caller":"backend/backend.go:549","msg":"finished defragmenting directory","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes-diff":0,"current-db-size-bytes":11018240,"current-db-size":"11 MB","current-db-size-in-use-bytes-diff":0,"current-db-size-in-use-bytes":11010048,"current-db-size-in-use":"11 MB","took":"283.469846ms"}
{"level":"info","ts":"2022-08-31T18:03:31.303Z","caller":"v3rpc/maintenance.go:95","msg":"finished defragment"}
time="2022-08-31T18:03:31Z" level=info msg="Failed to test data store connection: this server is a not a member of the etcd cluster. Found [e79044ef3c73-b6f3123a=<http://localhost:2380>], expect: e79044ef3c73-b6f3123a=172.17.0.2"
time="2022-08-31T18:03:32Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-08-31T18:03:33Z" level=info msg="Tunnel server egress proxy waiting for runtime core to become available"
time="2022-08-31T18:03:34Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-08-31T18:03:36Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-08-31T18:03:36Z" level=info msg="Defragmenting etcd database"
{"level":"info","ts":"2022-08-31T18:03:36.635Z","caller":"v3rpc/maintenance.go:89","msg":"starting defragment"}
{"level":"info","ts":"2022-08-31T18:03:36.639Z","caller":"backend/backend.go:497","msg":"defragmenting","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes":11018240,"current-db-size":"11 MB","current-db-size-in-use-bytes":11010048,"current-db-size-in-use":"11 MB"}
best-oil-69865
08/31/2022, 6:04 PMINFO: Running k3s server --cluster-init --cluster-reset
best-oil-69865
08/31/2022, 6:05 PMbest-oil-69865
08/31/2022, 6:05 PMbest-oil-69865
08/31/2022, 6:05 PMbest-oil-69865
08/31/2022, 6:07 PMbest-oil-69865
08/31/2022, 6:46 PM2022/08/31 18:45:24 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:24 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:29 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:29 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:33 [ERROR] error syncing 'fleet-default/c-g5d8r': handler rke-cluster-remove: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority, requeuing
2022/08/31 18:45:34 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:34 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update roles-manage: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:39 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:39 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update roles-manage: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:42 [ERROR] error syncing 'c-g5d8r': handler provisioning-cluster-create: failed to update fleet-default/c-g5d8r <http://provisioning.cattle.io/v1|provisioning.cattle.io/v1>, Kind=Cluster for provisioning-cluster-create c-g5d8r: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority, requeuing
2022/08/31 18:45:44 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:44 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:49 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:49 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:54 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:54 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:45:59 [INFO] Reconciling GlobalRoles
2022/08/31 18:45:59 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority
2022/08/31 18:46:01 [ERROR] error syncing 'fleet-local/local': handler rke-cluster-remove: Internal error occurred: failed calling webhook "<http://rancherauth.cattle.io|rancherauth.cattle.io>": failed to call webhook: Post "<https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s>": x509: certificate signed by unknown authority, requeuing
white-yacht-60472
08/31/2022, 6:54 PMpowerful-kangaroo-7234
08/31/2022, 7:12 PMbusy-easter-55684
09/01/2022, 2:06 AM