https://rancher.com/ logo
Title
w

witty-zebra-93264

04/04/2023, 1:19 PM
Hello. Are the rpm repositories down or is it just me? I’ve been getting similar responses for the past 1.5 hours.
404 Not Found
Code: NoSuchKey
Message: The specified key does not exist.
Key: rke2/latest/1.21/repodata/repomd.xml
RequestId: 6CQ27E9HR2YG8B8R
HostId: oa7Wg0AvPXJa6ktBRn6V4WNHriS4KhzbKjI2Y4H5toFuISnzAqQRtSAEQBjBMiZBiG7h6+dKszE=
c

creamy-pencil-82913

04/04/2023, 4:51 PM
We've escalated this to our infra engineering team. Not sure what's going on either.
w

witty-zebra-93264

04/04/2023, 4:52 PM
Thank you.
c

creamy-pencil-82913

04/04/2023, 6:17 PM
Can I ask where you got that path from? It appears to be missing the distro and architecture components
the repomd path should be something like
rke2/latest/1.21/centos/7/x86_64/repodata/repomd.xml
The key you’re looking from doesn’t match the repo structure, which suggests you have an invalid baseurl in your repo file
An example with latest
$ sudo cat /etc/zypp/repos.d/rancher-rke2-1-24-latest.repo
[rancher-rke2-common-latest]
name=Rancher RKE2 Common Latest
baseurl=<https://rpm.rancher.io/rke2/latest/common/centos/8/noarch>
enabled=1
gpgcheck=1
gpgkey=<https://rpm.rancher.io/public.key>

[rancher-rke2-1-24-latest]
name=Rancher RKE2 1.24 Latest
baseurl=<https://rpm.rancher.io/rke2/latest/1.24/centos/8/x86_64>
enabled=1
gpgcheck=1
gpgkey=<https://rpm.rancher.io/public.key>
$ kg no,po -A
NAME                    STATUS   ROLES                       AGE     VERSION
node/ip-172-31-19-229   Ready    control-plane,etcd,master   3m38s   v1.24.12+rke2r1

NAMESPACE         NAME                                                        READY   STATUS      RESTARTS   AGE
calico-system     pod/calico-kube-controllers-868d8d5ccb-hhlkz                1/1     Running     0          2m52s
calico-system     pod/calico-node-8dhn5                                       1/1     Running     0          2m52s
calico-system     pod/calico-typha-7d946cd5bf-69zhk                           1/1     Running     0          2m53s
kube-system       pod/cloud-controller-manager-ip-172-31-19-229               1/1     Running     0          3m33s
kube-system       pod/etcd-ip-172-31-19-229                                   1/1     Running     0          3m33s
kube-system       pod/helm-install-rke2-calico-crd-c6tth                      0/1     Completed   0          3m13s
kube-system       pod/helm-install-rke2-calico-mpl58                          0/1     Completed   1          3m13s
kube-system       pod/helm-install-rke2-coredns-8wpkh                         0/1     Completed   0          3m13s
kube-system       pod/helm-install-rke2-ingress-nginx-rnwzr                   0/1     Completed   0          3m13s
kube-system       pod/helm-install-rke2-metrics-server-cmxnn                  0/1     Completed   0          3m12s
kube-system       pod/kube-apiserver-ip-172-31-19-229                         1/1     Running     0          3m29s
kube-system       pod/kube-controller-manager-ip-172-31-19-229                1/1     Running     0          3m34s
kube-system       pod/kube-proxy-ip-172-31-19-229                             1/1     Running     0          3m14s
kube-system       pod/kube-scheduler-ip-172-31-19-229                         1/1     Running     0          3m34s
kube-system       pod/rke2-coredns-rke2-coredns-58fd75f64b-r5bcx              1/1     Running     0          3m3s
kube-system       pod/rke2-coredns-rke2-coredns-autoscaler-768bfc5985-78rtz   1/1     Running     0          3m3s
kube-system       pod/rke2-ingress-nginx-controller-7qs67                     1/1     Running     0          2m7s
kube-system       pod/rke2-metrics-server-74f878b999-g42t4                    1/1     Running     0          2m20s
tigera-operator   pod/tigera-operator-7cc7df76d5-zxrmv                        1/1     Running     0          2m59s
c

creamy-pencil-82913

04/04/2023, 7:04 PM
Sorry for the confusion, we had an internal report of this come in around the same time and I didn’t look closely at the URL you posted.
but unless there’s something broken in the install script (and I don’t see how) this appears to be a configuration issue on your side
w

witty-zebra-93264

04/04/2023, 7:05 PM
Unless the. urls changedd since yesterday..
Nothing about the command being run has changed in months
c

creamy-pencil-82913

04/04/2023, 7:06 PM
that URL has never been valid, given the structure of the yum repos.
w

witty-zebra-93264

04/04/2023, 7:07 PM
On second
So that base url up above that you provided.. it doesnt. work
<https://rpm.rancher.io/rke2/latest/1.24/centos/8/x86_64>
results in:
404 Not Found
Code: NoSuchKey
Message: The specified key does not exist.
Key: rke2/latest/1.24/centos/8/x86_64
RequestId: 9XN81FNAY6QNHEFD
HostId: mUq1pHZ++nj45wrCBKHY7vsn3fzFZNsxB3NUSubYbmJ51m7RPSvLXSjUwCSaC2axNBidXENUfk4=
c

creamy-pencil-82913

04/04/2023, 7:08 PM
they have always been structured as
<https://rpm.rancher.io/rke2/><channel>/<minor>/<dist>/<arch>
that’s the baseurl for the repo
are you trying to browse it or something?
you can’t do that
w

witty-zebra-93264

04/04/2023, 7:09 PM
This is the command I run. I have been running this command for atleast 6 months with no issue at all:
docker exec -it zarf-build-env-8.5 /bin/bash -c "dnf install --repofrompath=rke2-common,<https://rpm.rancher.io/rke2/latest/common/centos/8/noarch> --enablerepo rke2-common --repofrompath=rke2-core,<https://rpm.rancher.io/rke2/latest/1.24> /centos/8/x86_64 --enablerepo rke2-core --setopt=rke2-core.module_hotfixes=true --setopt=rke2-common.module_hotfixes=true --nogpgcheck --downloadonly --downloaddir /mnt/on-prem-staging/web/os/8.5/rke2 -y rke2-agent-1.24.10~rke2r1    rke2-server-1.24.10~rke2r1    rke2-common-1.24.10~rke2r1   "
Updating Subscription Management repositories.
Added rke2-common repo from <https://rpm.rancher.io/rke2/latest/common/centos/8/noarch>
Added rke2-core repo from <https://rpm.rancher.io/rke2/latest/1.24>
rke2-common                                                                                                                                                                                          1.1 kB/s | 2.0 kB     00:01    
rke2-core                                                                                                                                                                                            518  B/s | 371  B     00:00    
Errors during downloading metadata for repository 'rke2-core':
  - Status code: 404 for <https://rpm.rancher.io/rke2/latest/1.24/repodata/repomd.xml> (IP: 172.67.129.95)
Error: Failed to download metadata for repo 'rke2-core': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
c

creamy-pencil-82913

04/04/2023, 7:09 PM
you put an extra space in there
w

witty-zebra-93264

04/04/2023, 7:10 PM
I ran it last night with no issues. There were no changes between yesterday afternoon and this morning
c

creamy-pencil-82913

04/04/2023, 7:10 PM
repofrompath=rke2-core,<https://rpm.rancher.io/rke2/latest/1.24> /centos/8/x86_64
fix your typo
w

witty-zebra-93264

04/04/2023, 7:12 PM
That shouldnt be in there. Hmm. Wonder whats going on then
Will dig deeper.
c

creamy-pencil-82913

04/04/2023, 7:13 PM
that would explain 100% of what you’re seeing, you’re missing the repo and architecture from the baserul
and that extra space is right before those two components
b

breezy-painter-38605

04/04/2023, 7:32 PM
👋
c

creamy-pencil-82913

04/04/2023, 8:01 PM
@witty-zebra-93264 can you confirm whether or not removing that space fixed your issue?
w

witty-zebra-93264

04/04/2023, 9:32 PM
Had to step out for an appt. Will be able to confirm here shortly.
Confirmed that things are working as expected. For some reason Make was adding a space to the end of a variable that has a comment on the same line.
👍 1
Thank you both for helping solve this. NGL.. I’m slightly embarrassed I did not catch the space.