rancher-users #general

hundreds-terabyte-36933

09/11/2022, 3:20 PM

@agreeable-oil-87482 do you know if there is a plan to support array as a type in questions.yaml?

hundreds-terabyte-36933

09/11/2022, 3:23 PM

Copy code

my_web_app:
  https:
    hosts:
      - <http://abc.com|abc.com>
      - <http://123.com|123.com>

hundreds-terabyte-36933

09/11/2022, 3:23 PM

no way to implement that for instance via questions.yaml

hundreds-terabyte-36933

09/11/2022, 3:40 PM

Did you ever get an answer for this?

thousands-oyster-32502

09/12/2022, 3:16 AM

@tall-school-18125 how did you figure it out?

modern-piano-42327

09/12/2022, 5:14 AM

docker run -d --restart=unless-stopped -p 80:80 -p 443:443 --privileged rancher/rancher

Rancher Docker container is unable to start Logs : -

INFO: Running k3s server --cluster-init --cluster-reset

2022/09/12 05:05:08 [INFO] Rancher version v2.6.8 (f650ce839) is starting

2022/09/12 05:05:08 [INFO] Rancher arguments {ACMEDomains:[] AddLocal:true Embedded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:false Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit.log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Features: ClusterRegistry:}

2022/09/12 05:05:08 [INFO] Listening on /tmp/log.sock

2022/09/12 05:05:08 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:10 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:12 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:14 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:16 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:18 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:20 [INFO] Waiting for server to become available: Get "<https://127.0.0.1:6444/version?timeout=15m0s>": dial tcp 127.0.0.1:6444: connect: connection refused

2022/09/12 05:05:28 [INFO] Running in single server mode, will not peer connections

2022/09/12 05:05:28 [INFO] Applying CRD <http://features.management.cattle.io|features.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://navlinks.ui.cattle.io|navlinks.ui.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://clusters.management.cattle.io|clusters.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://apiservices.management.cattle.io|apiservices.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://clusterregistrationtokens.management.cattle.io|clusterregistrationtokens.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://settings.management.cattle.io|settings.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://preferences.management.cattle.io|preferences.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://features.management.cattle.io|features.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://clusterrepos.catalog.cattle.io|clusterrepos.catalog.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://operations.catalog.cattle.io|operations.catalog.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://apps.catalog.cattle.io|apps.catalog.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://fleetworkspaces.management.cattle.io|fleetworkspaces.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://managedcharts.management.cattle.io|managedcharts.management.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://clusters.provisioning.cattle.io|clusters.provisioning.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://clusters.provisioning.cattle.io|clusters.provisioning.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://rkeclusters.rke.cattle.io|rkeclusters.rke.cattle.io>

2022/09/12 05:05:29 [INFO] Applying CRD <http://rkecontrolplanes.rke.cattle.io|rkecontrolplanes.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://rkebootstraps.rke.cattle.io|rkebootstraps.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://rkebootstraptemplates.rke.cattle.io|rkebootstraptemplates.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://rkecontrolplanes.rke.cattle.io|rkecontrolplanes.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://custommachines.rke.cattle.io|custommachines.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://etcdsnapshots.rke.cattle.io|etcdsnapshots.rke.cattle.io>

2022/09/12 05:05:30 [INFO] Applying CRD <http://clusters.cluster.x-k8s.io|clusters.cluster.x-k8s.io>

2022/09/12 05:05:30 [FATAL] k3s exited with: exit status 1

gorgeous-army-49867

09/12/2022, 7:41 AM

hello, been trying to install rancher desktop on w10 as a more convenient docker+wsl setup. was successful with 1 pc (rancher 1.5.0) although i remember docker not starting correctly at the first attempts (not sure what helped) tried installing now (ranhcer 1.5.1) on my work pc docker does not start.

Copy code

error during connect: Get "<http://localhost:2375/v1.24/containers/json>": dial tcp [::1]:2375: connectex: No connection could be made because the target machine actively refused it.

looking at logs and diffing between two machines i see this:

Copy code

time="2022-09-12T07:01:32.085265700Z" level=info msg="Loading containers: start."
time="2022-09-12T07:01:32.143184300Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
time="2022-09-12T07:01:32.171789200Z" level=info msg="Loading containers: done."
time="2022-09-12T07:01:32.210623800Z" level=info msg="Docker daemon" commit=f756502055d2e36a84f2068e6620bea5ecf09058 graphdriver(s)=overlay2 version=20.10.16
time="2022-09-12T07:01:32.211010500Z" level=info msg="Daemon has completed initialization"
time="2022-09-12T07:01:32.240380700Z" level=info msg="API listen on /mnt/wsl/rancher-desktop/run/docker.sock"
time="2022-09-12T07:01:32.243100200Z" level=info msg="API listen on /var/run/docker.sock"
time="2022-09-12T07:01:47.099732600Z" level=error msg="(*service).Write failed" error="rpc error: code = Unavailable desc = ref moby/1/manifest-sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4 locked for 248.3627ms (since 2022-09-12 07:01:46.8005976 +0000 UTC m=+14.892781301): unavailable" expected="sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4" ref="manifest-sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4" total=526
time="2022-09-12T07:01:47.610257200Z" level=error msg="(*service).Write failed" error="rpc error: code = Unavailable desc = ref moby/1/manifest-sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4 locked for 721.2654ms (since 2022-09-12 07:01:46.8005976 +0000 UTC m=+14.892781301): unavailable" expected="sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4" ref="manifest-sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4" total=526

alert-fireman-21958

09/12/2022, 9:00 AM

hi team i am unable import cluster in my rancher dashboard error: resource mapping not found for name: "cattle-admin-binding" namespace: "cattle-system" from "STDIN": no matches for kind "ClusterRoleBinding" in version "rbac.authorization.k8s.io/v1beta1" can any one help me on this issue

refined-agent-67029

09/12/2022, 10:52 AM

Hello good morning, in my company we use Rancher to deploy our applications, is it possible to obtain a report with the history of deployments made by each user with their date? Thank you very much in advance.

salmon-carpenter-62625

09/12/2022, 12:14 PM

Hi, I just read about monitoring v2 implemnted for rancher2 above 2.6. My goal is to have separate observability cluster that will collect metrics from all our k8s clusters. Is it possible to use existing monitoring solution from rancher to get this goal? I see there is some extra pushprox application. Is it capable to collect from it a metrics from different clusters (on separate networks) and deliver to this observability cluster? Or should I do some sort of prometheus setup in federation mode to have some primary-secondary model?

jolly-area-75887

09/12/2022, 12:39 PM

Hi, Any one having trouble accessing namespaces created in rancher using

kubectl

I get this error

Copy code

kubectl get ns --kubeconfig=rancher-project-admin.yaml
Error from server (Forbidden): namespaces is forbidden: User "u-xxxxxx" cannot list resource "namespaces" in API group "" at the cluster scope

brash-planet-10109

09/12/2022, 2:11 PM

Hi All, In a 9 node cluster, one master (etcd+controlplane) and 8 worker nodes. No need of any load balancer I believe. But what if I have 3 master nodes and 6 worker nodes. Does rancher manages load balancing on it's own? Or specifically we need to deploy load balancing for this? I've deployed rancher using docker in a VM and from rancher UI I've provisioned Kubernetes cluster

eager-refrigerator-66976

09/12/2022, 2:22 PM

Hey guys! anyone had issues with rancher just deletes managed custom cluster on attempt to modify cluster configuration? I’ve submitted bug here https://github.com/rancher/rancher/issues/38833 this is very scary… my clusters are just destroyed when I modify cluster configuration…

🙏 1

kind-analyst-38351

09/12/2022, 2:43 PM

Hey, I launched a single node cluster inside a VPN, I have an external IP address that points to the VM (which hosts the RKE cluster). How can I add another IP address for the x509 certificate so I can access the cluster from outside the VPN?

dry-angle-26883

09/12/2022, 3:18 PM

i'm having this issue, not sure why

kind-analyst-38351

09/12/2022, 4:20 PM

If anyone stuck in this I found the solution: https://rancher.com/docs/rke/latest/en/config-options/authentication/

incalculable-school-7570

09/12/2022, 5:22 PM

Did you refresh helm (helm repo update) or maybe your helm repository isn't called rancher-latest (helm repo list)

☝️ 1

dazzling-computer-84464

09/12/2022, 7:25 PM

Copy code

{
  "baseType": "error",
  "code": "ServerError",
  "message": "error getting tokens for user: u-wkdcbhe4uz selector: <http://authn.management.cattle.io/token-userId=u-wkdcbhe4uz|authn.management.cattle.io/token-userId=u-wkdcbhe4uz>  err: the server was unable to return a response in the time allotted, but may still be processing the request (get <http://tokens.meta.k8s.io|tokens.meta.k8s.io>)",
  "status": 500,
  "type": "error"
}

After upgrading to 2.6.6, the api https://rancher.domain.com/v3/tokens or user account & api key page not working anymore. Does anyone know how to fix this issue?

dazzling-computer-84464

09/12/2022, 7:26 PM

RKE K8 version 1.21

proud-salesmen-12221

09/13/2022, 1:53 AM

Hi Everyone, I'm new to kubernetes and RKE2. I just setup a 3 node cluster using vagrant and installed one server and two agents and I see that a couple of my ingress Pods are stuck in 'ContainerCreating' and a couple Canal Pods stopped with 'CrashLoopBackOff'. Is this expected/normal?

Copy code

[vagrant@rke2-server1 ~]$ kubectl get pods -A -o wide
NAMESPACE     NAME                                                    READY   STATUS              RESTARTS         AGE     IP               NODE           NOMINATED NODE   READINESS GATES
kube-system   cloud-controller-manager-rke2-server1                   1/1     Running             2 (174m ago)     3h14m   10.0.2.15        rke2-server1   <none>           <none>
kube-system   etcd-rke2-server1                                       1/1     Running             1 (175m ago)     3h14m   192.168.33.101   rke2-server1   <none>           <none>
kube-system   helm-install-rke2-canal-c48pq                           0/1     Completed           0                3h14m   10.0.2.15        rke2-server1   <none>           <none>
kube-system   helm-install-rke2-coredns-znhbd                         0/1     Completed           0                3h14m   10.0.2.15        rke2-server1   <none>           <none>
kube-system   helm-install-rke2-ingress-nginx-fbp8s                   0/1     Completed           0                3h14m   10.42.0.4        rke2-server1   <none>           <none>
kube-system   helm-install-rke2-metrics-server-4kcj7                  0/1     Completed           0                3h14m   10.42.0.2        rke2-server1   <none>           <none>
kube-system   kube-apiserver-rke2-server1                             1/1     Running             1 (175m ago)     3h14m   192.168.33.101   rke2-server1   <none>           <none>
kube-system   kube-controller-manager-rke2-server1                    1/1     Running             2 (174m ago)     3h14m   10.0.2.15        rke2-server1   <none>           <none>
kube-system   kube-proxy-rke2-agent1                                  1/1     Running             0                173m    10.0.2.15        rke2-agent1    <none>           <none>
kube-system   kube-proxy-rke2-agent2                                  1/1     Running             0                173m    10.0.2.15        rke2-agent2    <none>           <none>
kube-system   kube-proxy-rke2-server1                                 1/1     Running             1 (175m ago)     3h14m   192.168.33.101   rke2-server1   <none>           <none>
kube-system   kube-scheduler-rke2-server1                             1/1     Running             1 (175m ago)     3h14m   192.168.33.101   rke2-server1   <none>           <none>
kube-system   rke2-canal-m8vb6                                        2/2     Running             2 (175m ago)     3h14m   10.0.2.15        rke2-server1   <none>           <none>
kube-system   rke2-canal-ptnk8                                        0/2     CrashLoopBackOff    110 (87s ago)    3h10m   10.0.2.15        rke2-agent2    <none>           <none>
kube-system   rke2-canal-rmnv6                                        0/2     CrashLoopBackOff    110 (2m2s ago)   3h13m   10.0.2.15        rke2-agent1    <none>           <none>
kube-system   rke2-coredns-rke2-coredns-76cb76d66-mkv2c               1/1     Running             1 (175m ago)     3h14m   10.42.0.12       rke2-server1   <none>           <none>
kube-system   rke2-coredns-rke2-coredns-76cb76d66-t569h               0/1     ContainerCreating   0                3h13m   <none>           rke2-agent1    <none>           <none>
kube-system   rke2-coredns-rke2-coredns-autoscaler-58867f8fc5-8n589   1/1     Running             1 (175m ago)     3h14m   10.42.0.11       rke2-server1   <none>           <none>
kube-system   rke2-ingress-nginx-controller-c8vmd                     0/1     ContainerCreating   0                3h9m    <none>           rke2-agent2    <none>           <none>
kube-system   rke2-ingress-nginx-controller-n9st4                     1/1     Running             1 (175m ago)     3h14m   10.42.0.13       rke2-server1   <none>           <none>
kube-system   rke2-ingress-nginx-controller-rdml6                     0/1     ContainerCreating   0                3h12m   <none>           rke2-agent1    <none>           <none>
kube-system   rke2-metrics-server-6979d95f95-4z57b                    1/1     Running             1 (175m ago)     3h14m   10.42.0.10       rke2-server1   <none>           <none>

✅ 1

flaky-shampoo-86024

09/13/2022, 3:14 AM

Hi, am able to use ingress-nginx to access rancher URL via NLB created by ingress. Now I want to use Istio instead of ingress-nginx in EKS to access rancher url. I removed ingress-nginx, and installed istio-ingress, but its giving SSL errors. Any implementation guide pls, for istio based rancher setup only.

strong-painting-96413

09/13/2022, 3:25 AM

Hi everyone, I need help with few issues. 1. I tried to create a postgresql container as a deployment workload in Rancher Desktop following this article https://www.hanaburtin.net/archives/83 without the NFS replication. Then created databases and users related to an application, and the application was running fine. But when I restart Rancher, the entire postgresql is truncated as a new one. The created databases and users are lost. 2. While restarting Rancher, is there any way to create an order in which the containers should start running? For deploying a micro-services application, the services must be started in certain order. The database container must be in ready state for the other services to start. So is there any way to ensure that. 3. When restarting Rancher, the IP Address of existing containers is getting changed sometimes. Is there any way to fix that? We've checked that Cluster IP doesn't change after restarting, but not sure if that's the correct way of referring containers. If anyone has faced and solved these issues, please share the references to follow.

fresh-king-12269

09/13/2022, 5:50 AM

Hi, kubernetes settings and supporting utilities not showing for me. Version 1.5.1 on Mac M1. Anyone familiar with this issue ? Thanks

echoing-ability-7881

09/13/2022, 8:04 AM

@chan

gorgeous-minister-309

09/13/2022, 8:04 AM

Hello. I'm trying to deploy a cluster in a vSphere environment, without success. I've tried using RKE1, RKE2, even k3s but nothing works. I'll describe one of my attempts, using RKE2. I'm using a Ubuntu 20.04 template, including vmtoolsd. The virtual machine is created in vsphere, boots and get an IP address correctly. Then the installation script is executed (/usr/local/custom_script/install.sh) and is looping on the

retrieve_connection_info

function. The call to

/v3/connect/agent

is failing with a 401 Unauthorized error. The rancher server is accessible from the virtual machine. The script is called without any parameters but includes some references to my rancher instance :

CATTLE_AGENT_BINARY_BASE_URL

CATTLE_SERVER

CATTLE_TOKEN

. I don't understand why this is failing. Any idea?

echoing-ability-7881

09/13/2022, 8:05 AM

Hi guys, i want to know one thing My application and database are running in same cluster, i want to connect my database with application how to do it in rancher.

some-addition-13540

09/13/2022, 8:21 AM

Does rancher backup now support Azure Blob Storage seeing that Minio S3 -> Azure Blob Storage gateway is now deprecated

powerful-notebook-71999

09/13/2022, 12:36 PM

Hello all, Does anyone work with Rancher + Prometheus alerts + (possibly Slack or PagerDuty)? I need to configure 1) timing of scraping and 2) timing of sending alerts to slack when it is fired We have rancher 2.6.7 and Prometheus (from Apps charts) I have configured to send slack alerts, and I am getting alerts, but cannot find interval for scraping. Like, its sending fire alerts whenever it thinks it should be sending… 😏 I have under Monitoring > Advanced > PrometheusRules > resource kubernetes-apps and inside Group Name: kubernetes-apps (runbook from Github repo). Now I have changed timing of it in PromQL as well as duration which is given in seconds (above PromQL). I just dont know whether it is the location to configure scraping and sending alerts or does it have to be set through PodMonitoring in Monitoring (though podmonitoring should be just for pods) Please help…

billions-honey-62634

09/13/2022, 10:22 PM

You want to create the Persistent Volume that uses hostpath first with a similar manifest

Copy code

kind: PersistentVolume
apiVersion: v1
metadata:
  name: hostpath-pv
spec:
  capacity:
    storage: 1Gi
  accessModes:
    - ReadWriteOnce
  reclaimPolicy:
    - Recycle
  hostPath:
    path: "/data"

blue-tomato-62407

09/14/2022, 1:17 AM

Has anyone had an issue with Rancher docker deployments not generating a new cert? It seems to be stuck using one that was set to expire last month after an attempt to update it, which is causing issues with getting nodes to properly register with Rancher again.