I have addedd file:
- /etc/rancher/rke2/config.yaml.d/55-openstack.yaml
with content:
{
"cloud-provider-config": "/etc/rancher/rke2/cloud.conf",
"cloud-provider-name": "external"
}
root@cltst-pool1-a9366016-2cq28:~# cat /etc/rancher/rke2/cloud.conf
[Global]
auth-url="<keystone URL>"
domain-name="<domain>"
tenant-name="BUILD"
username="Admin"
password="<password>"
tls-insecure = true
[LoadBalancer]
use-octavia=true
lb-provider="octavia"
subnet-id="96f8e0b6-e5a4-4b8a-aeea-e6c2f9759a2e"
create-monitor=true
monitor-delay=60s
monitor-timeout=30s
monitor-max-retries=5
manage-security-groups=true
[Networking]
ipv6-support-disabled=true
[BlockStorage]
bs-version=v2
followed agent restart -> all green
Then I made controller deployment in context of cluster -> controller is working with logs:
ubuntu@czbrn-sky-jmp-001:~$ kubectl logs -n kube-system pods/cloud-controller-manager-cltst-pool1-a9366016-2cq28
I0610 14
4418.410692 1 serving.go:354] Generated self-signed cert in-memory
I0610 14
4418.539458 1 controllermanager.go:142] Version: v1.22.1-k3s1
I0610 14
4418.542287 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
I0610 14
4418.542369 1 shared_informer.go:240] Waiting for caches to sync for RequestHeaderAuthRequestController
I0610 14
4418.542468 1 configmap_cafile_content.go:201] "Starting controller" name="client-ca:
kube systemextension apiserver authentication:client-ca-file"
I0610 14
4418.542527 1 shared_informer.go:240] Waiting for caches to sync for client-ca:
kube systemextension apiserver authentication:client-ca-file
I0610 14
4418.542578 1 configmap_cafile_content.go:201] "Starting controller" name="client-ca:
kube systemextension apiserver authentication:requestheader-client-ca-file"
I0610 14
4418.542621 1 shared_informer.go:240] Waiting for caches to sync for client-ca:
kube systemextension apiserver authentication:requestheader-client-ca-file
I0610 14
4418.542733 1 secure_serving.go:200] Serving securely on 127.0.0.1:10258
I0610 14
4418.543349 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0610 14
4418.544142 1 leaderelection.go:248] attempting to acquire leader lease kube-system/cloud-controller-manager...
I0610 14
4418.551965 1 leaderelection.go:258] successfully acquired lease kube-system/cloud-controller-manager
I0610 14
4418.552232 1 event.go:291] "Event occurred" object="kube-system/cloud-controller-manager" kind="Lease" apiVersion="
coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="cltst-pool1-a9366016-2cq28_eb15f228-df6e-4734-8575-21c704306e6d became leader"
I0610 14
4418.643526 1 shared_informer.go:247] Caches are synced for client-ca:
kube systemextension apiserver authentication:requestheader-client-ca-file
I0610 14
4418.643755 1 shared_informer.go:247] Caches are synced for RequestHeaderAuthRequestController
I0610 14
4418.643872 1 shared_informer.go:247] Caches are synced for client-ca:
kube systemextension apiserver authentication:client-ca-file
I0610 14
4418.662187 1 node_controller.go:115] Sending events to api server.
I0610 14
4418.662320 1 controllermanager.go:285] Started "cloud-node"
I0610 14
4418.662372 1 node_controller.go:154] Waiting for informer caches to sync
I0610 14
4418.663674 1 node_lifecycle_controller.go:76] Sending events to api server
I0610 14
4418.663767 1 controllermanager.go:285] Started "cloud-node-lifecycle"
E0610 14
4418.665273 1 core.go:92] Failed to start service controller: the cloud provider does not support external load balancers
W0610 14
4418.665307 1 controllermanager.go:282] Skipping "service"
I0610 14
4418.665357 1 core.go:103] Will not configure cloud provider routes, --configure-cloud-routes: false <----- that bugs me --->
W0610 14
4418.665374 1 controllermanager.go:282] Skipping "route"
I0610 14
4418.763597 1 node_controller.go:390] Initializing node cltst-pool1-a9366016-2cq28 with cloud provider
I0610 14
4418.777926 1 node_controller.go:454] Successfully initialized node cltst-pool1-a9366016-2cq28 with cloud provider
I0610 14
4418.778260 1 event.go:291] "Event occurred" object="cltst-pool1-a9366016-2cq28" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
I0610 14
4914.996305 1 node_controller.go:390] Initializing node cltst-pool2-c1951d7e-fnrdv with cloud provider
E0610 14
4915.001133 1 node_controller.go:212] error syncing 'cltst-pool2-c1951d7e-fnrdv': failed to get provider ID for node cltst-pool2-c1951d7e-fnrdv at cloudprovider: failed to get instance ID from cloud provider: address annotations not yet set, requeuing
I0610 14
4915.005955 1 node_controller.go:390] Initializing node cltst-pool2-c1951d7e-fnrdv with cloud provider
E0610 14
4915.006047 1 node_controller.go:212] error syncing 'cltst-pool2-c1951d7e-fnrdv': failed to get provider ID for node cltst-pool2-c1951d7e-fnrdv at cloudprovider: failed to get instance ID from cloud provider: address annotations not yet set, requeuing
I0610 14
4915.016210 1 node_controller.go:390] Initializing node cltst-pool2-c1951d7e-fnrdv with cloud provider
E0610 14
4915.016313 1 node_controller.go:212] error syncing 'cltst-pool2-c1951d7e-fnrdv': failed to get provider ID for node cltst-pool2-c1951d7e-fnrdv at cloudprovider: failed to get instance ID from cloud provider: address annotations not yet set, requeuing
I0610 14
4915.020485 1 node_controller.go:390] Initializing node cltst-pool2-c1951d7e-fnrdv with cloud provider
I0610 14
4915.171694 1 node_controller.go:454] Successfully initialized node cltst-pool2-c1951d7e-fnrdv with cloud provider
I0610 14
4915.174165 1 event.go:291] "Event occurred" object="cltst-pool2-c1951d7e-fnrdv" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
Testing deployment is in pending with no changes in Octavia configuration (LBaaS)
jmp-001:~$ kubectl get svc -n default
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
kubernetes ClusterIP 10.43.0.1 <none> 443/TCP 6h41m
my-np-service LoadBalancer 10.43.224.222 <pending> 80:30441/TCP 4h15m