rancher-users #general

creamy-tiger-50940

11/08/2022, 9:59 PM

Hi. After turning off all 3 master servers 1 server is missing in 'kubectl get nodes' and in gui. How can I readd it correctly? I see in etcd that it cannot be added because ''the member has been permanently removed from the cluster'. Should I reinstall server and add it one more time?

creamy-tiger-50940

11/08/2022, 10:01 PM

Second question - what are the recommended steps to correcly shut down whole rke2 cluster for maintenance? I need to turn off all servers. Should I just do 'shutdown -h now' in OS or stop some services manually before?

kind-oil-96371

11/09/2022, 6:25 AM

👋 Hi everyone! I’m looking for help running Postgresql under Rancher. I’ve installed Rancher.Desktop-1.6.2.x86_64 on MacOs Ventura. Run a few sample containers - no problems. But when I

docker compose up

a Postgres container that previously ran under Docker I get a lot of this

Copy code

chown: /var/lib/postgresql/data/base/16400/2836: Permission denied

echoing-napkin-70336

11/09/2022, 6:50 AM

👋 Hi everyone!

fast-ice-89102

11/09/2022, 7:22 AM

Folks, looking for some insights and guidance. My team works on some telecom network SW that has so far been tested (quite extensively) on an on-prem, curated K8s setup created using kubeadm. Our SW is sensitive to CNI nuances for reliability & performance. However one of our potential customers uses RKE2 and asking us if our SW can be deployed on RKE2. Is there a way to use RKE2 in our lab that mimics potential customer's deployment ? And if so, is there a laundry list of questions to ask s.t. our configuration is representative of what this potential customer has ? I'm guessing the list to include things like worker node configuration, worker node operating system, Kubernetes version/RKE2 release #, networking specifics like topology, CNI choices available, network services available, security/policy architecture choices ? I'm sorry my question is perhaps a bit fuzzy, as I am not a real K8s expert.

silly-jordan-81965

11/09/2022, 8:27 AM

Question: Openstack adress pairs - is that something that could be done in the openstackmachine config? Or perhaps something that would be available in the future?

👍 1

🙌 1

big-air-84716

11/09/2022, 8:36 AM

Hello everyone ⭐ Question: In Rancher v2.6.8 can`t found a way to connect to master RKE2 nodes directly. They not exist in

kubeconfig

like before. Any idea how to overcome the situation?

brief-eve-68728

11/09/2022, 1:08 PM

Hi, Anyone got any idea what might be wrong with my Windows pc? This all happened after I updated to the latest version of Rancher. Rancher gets stuck at startup at this step: 'Updating /etc/hosts Error: could not detect WSL2 VM: could not find WSL2 VM ID: could not dial VM 8D0784A5-6234-4457-B567-D775E173BDB5: could not dial Hyper-V socket: connect(8d0784a5-6234-4457-b567-d775e173bdb5:016a6eb7-facb-11e6-bd58-64006a7986d3) failed: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. Thanks!

refined-scooter-11467

11/09/2022, 1:18 PM

Hello, Does anyone know how to see the containers that are running in rancher desktop ?

freezing-tailor-4245

11/09/2022, 1:43 PM

Hi everyone, thanks for letting me in! I have a very simple question regarding the standard Traefik implementation in Rancher desktop: is there a way to annotate the default ingress controller created when I tick the "enable Traefik" option? I would like the DAPR sidecar to be injected. If not, I'll create a separate one. Thanks!

chilly-nail-71443

11/09/2022, 2:09 PM

Hi, guys. I wanted to run my docker image on k3s using rancher desktop, but my k3s doesn't have access to my private docker registry. How can I add this registry to k3s on windows?

powerful-elephant-25838

11/10/2022, 9:40 AM

is possible to have the rancher cli pointing directly to the downstream cluster and NOT to the rancher upstream?

square-policeman-85866

11/10/2022, 11:55 AM

Hi, we are currently trying to deploy rancher backup version 2.1.3 but running into this error ‘Error: failed to create typed patch object: .type field not declared in schmea’

great-london-38353

11/10/2022, 2:46 PM

Posted in #rancher-desktop

Copy code

Hi , Looking for help on Rancher Desktop install for MacOS 10.15.7.
Configuration fails v1.6.2 with below error
limactl shell --workdir=. 0 sudo /sbin/rc-service --ifnotstarted docker start
 * /var/log/docker.log: creating file
 * /var/log/docker.log: correcting owner
 * Starting Docker Daemon ... [ ok ]
2022-11-03T17:29:22.990Z: > limactl copy /Applications/Rancher <http://Desktop.app/Contents/Resources/resources/linux/internal/rancher-desktop-guestagent|Desktop.app/Contents/Resources/resources/linux/internal/rancher-desktop-guestagent> 0:./rancher-desktop-guestagent
$ Error: spawn /Applications/Rancher <http://Desktop.app/Contents/Resources/resources/darwin/lima/bin/limactl|Desktop.app/Contents/Resources/resources/darwin/lima/bin/limactl> EACCES

melodic-soccer-13436

11/10/2022, 10:36 PM

Hello Rancherinos! We are having a problem where our rancher nodes are failing to pull the nginx workload from the registry. Here is the exact error:

Copy code

Failed to pull image "rancher/nginx-ingress-controller:nginx-0.43.0-rancher3": rpc error: code = Unknown desc = Error response from daemon: Get <https://registry-1.docker.io/v2/>: read tcp 10.209.67.160:34784->3.216.34.172:443: read: connection reset by peer

melodic-soccer-13436

11/10/2022, 10:37 PM

Is there a more recent nginx image, and if so, how do we get our controller to point to it?

orange-hospital-37139

11/11/2022, 5:24 AM

👋 Hi everyone!

clean-family-59127

11/11/2022, 8:13 AM

[Blog Post] Helm has been the most used and adopted Kubernetes package manager. Though helm helps you to easily deploy even your most complex application over k8s, there are certain challenges with helm cli that need to be addressed. Look at this blog where I tried to cover some of the challenges and how they can be solved using the lightweight Helm Dashboard. Feel free to give any suggestions/feedback https://dev.to/abhinavd26/the-kubernetes-dashboard-for-helm-20f4

lively-night-78214

11/11/2022, 10:47 AM

hi folks, i am running rancher1 and i would like to backup its configuration and move it to mysql, is it possible?

best-oil-69865

11/11/2022, 10:57 AM

anyone can is it possible to upgrade from Rancher 2.6.2 to 2.6.9 if so after upgrade 30mins I could see in docker logs as one line

Copy code

INFO: Running k3s server --cluster-init --cluster-reset

best-oil-69865

11/11/2022, 10:57 AM

I been struggling almost from 2.6.2 to any version is not happening

best-oil-69865

11/11/2022, 10:58 AM

in the k3s-cluster-reset.log I could see

Copy code

time="2022-11-11T10:52:57Z" level=info msg="Tunnel server egress proxy waiting for runtime core to become available"
time="2022-11-11T10:52:57Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-11-11T10:52:59Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-11-11T10:53:00Z" level=info msg="Defragmenting etcd database"
{"level":"info","ts":"2022-11-11T10:53:00.739Z","caller":"v3rpc/maintenance.go:89","msg":"starting defragment"}
{"level":"info","ts":"2022-11-11T10:53:00.742Z","caller":"backend/backend.go:497","msg":"defragmenting","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes":11030528,"current-db-size":"11 MB","current-db-size-in-use-bytes":11022336,"current-db-size-in-use":"11 MB"}
{"level":"info","ts":"2022-11-11T10:53:01.046Z","caller":"backend/backend.go:549","msg":"finished defragmenting directory","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes-diff":0,"current-db-size-bytes":11030528,"current-db-size":"11 MB","current-db-size-in-use-bytes-diff":0,"current-db-size-in-use-bytes":11022336,"current-db-size-in-use":"11 MB","took":"307.037498ms"}
{"level":"info","ts":"2022-11-11T10:53:01.046Z","caller":"v3rpc/maintenance.go:95","msg":"finished defragment"}
{"level":"warn","ts":"2022-11-11T10:53:01.046Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-11-11T10:53:00.739Z","time spent":"307.234995ms","remote":"127.0.0.1:42248","response type":"/etcdserverpb.Maintenance/Defragment","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""}
time="2022-11-11T10:53:01Z" level=info msg="Failed to test data store connection: this server is a not a member of the etcd cluster. Found [76479e4b0f3b-b44fb66a=<http://localhost:2380>], expect: 76479e4b0f3b-b44fb66a=<https://172.17.0.2:2380>"
time="2022-11-11T10:53:01Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-11-11T10:53:02Z" level=info msg="Tunnel server egress proxy waiting for runtime core to become available"
time="2022-11-11T10:53:03Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-11-11T10:53:05Z" level=error msg="CA cert validation failed: Get \"<https://127.0.0.1:6444/cacerts>\": x509: certificate signed by unknown authority"
time="2022-11-11T10:53:06Z" level=info msg="Defragmenting etcd database"
{"level":"info","ts":"2022-11-11T10:53:06.365Z","caller":"v3rpc/maintenance.go:89","msg":"starting defragment"}
{"level":"info","ts":"2022-11-11T10:53:06.368Z","caller":"backend/backend.go:497","msg":"defragmenting","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes":11030528,"current-db-size":"11 MB","current-db-size-in-use-bytes":11022336,"current-db-size-in-use":"11 MB"}
{"level":"info","ts":"2022-11-11T10:53:06.675Z","caller":"backend/backend.go:549","msg":"finished defragmenting directory","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/db","current-db-size-bytes-diff":0,"current-db-size-bytes":11030528,"current-db-size":"11 MB","current-db-size-in-use-bytes-diff":0,"current-db-size-in-use-bytes":11022336,"current-db-size-in-use":"11 MB","took":"309.935671ms"}
{"level":"info","ts":"2022-11-11T10:53:06.675Z","caller":"v3rpc/maintenance.go:95","msg":"finished defragment"}
{"level":"warn","ts":"2022-11-11T10:53:06.675Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-11-11T10:53:06.365Z","time spent":"310.138221ms","remote":"127.0.0.1:42280","response type":"/etcdserverpb.Maintenance/Defragment","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""}
time="2022-11-11T10:53:06Z" level=info msg="Failed to test data store connection: this server is a not a member of the etcd cluster. Found [76479e4b0f3b-b44fb66a=<http://localhost:2380>], expect: 76479e4b0f3b-b44fb66a=<https://172.17.0.2:2380>"

best-oil-69865

11/11/2022, 10:58 AM

I have no idea

careful-article-61190

11/11/2022, 10:58 AM

Hi 👋

best-oil-69865

11/11/2022, 10:58 AM

Copy code

docker run -d --name=rancher-2.6.9 --restart=unless-stopped -p 80:80 -p 443:443 --privileged -v /data/rancher:/var/lib/rancher rancher/rancher:v2.6.9 --acme-domain <http://dock-dbss.io|dock-dbss.io>

best-oil-69865

11/11/2022, 10:59 AM

it will be great that if anyone could say why the upgrade is not happening

lively-night-78214

11/11/2022, 11:57 AM

Can anyone help with this? https://forums.rancher.com/t/back-up-rancher-1-6-configuration-to-mysql/39434

powerful-elephant-25838

11/11/2022, 4:53 PM

I've installed 2 rancher instances rancher1 and rancher2 and use an haproxy in tcp for both but I have trouble accessing rancher2 it only works if I clear the cache of the browser. Is there something I could have misconfigured?

careful-article-61190

11/11/2022, 6:04 PM

Good morning everyone, I got question. I installed rancher onprem Vsphere network. When I create new cluster it gets stuck with waiting for etcd to register. Ultimately i figure out there are two things needs to make it work, add /etc/hosts entries " IP_OF_RANCHER_HOST hostdomain" this registers the cluster to rancher. So my question is why DNS is not resolving with new cluster. ? Do I need any additional automation step to make dns resolve here?

careful-article-61190

11/11/2022, 6:35 PM

Hi also i have to patch this

Copy code

kubectl -n cattle-system patch  deployments cattle-cluster-agent --patch '{
    "spec": {
        "template": {
            "spec": {
                "hostAliases": [
                    {
                      "hostnames":
                      [
                        "<http://stage-k8senv1.xxx.se|stage-k8senv1.xxx.se>"
                      ],
                      "ip": "172.20.10.100"
                    },
                    {
                      "hostnames":
                      [
                        "<http://stage-k8senv1.xxx.se|stage-k8senv1.xxx.se>"
                      ],
                      "ip": "172.20.10.101"
                    }

                ]
            }
        }
    }
}'

Which allows cluster agent to connect. Any permanent solution? when we create downstreame cluster in rancher it should work out of the box?