Hi Team, My SSL certificate expired today, and I n...
# harvester
b
Hi Team, My SSL certificate expired today, and I now have a new certificate available. Could you please assist in replacing the existing SSL certificate or removing it from Harvester? Currently, the Harvester UI is not accessible.
t
are you using chrome?
b
im using firefox
t
you should be able to get by the outdated cert to get the to gui.
do you have access to a kubeconfig?
b
im able to access ssh
t
ok. let me see if I can find the settings from
kubectl
kubectl get settings ssl-certificates
to see the old ones.
you can edit it to update.
or set it to
{}
to reset it to self signed and then go into the GUI and add the new ones.
b
im getting this error
t
sudo -i
run those as root
b
im running from the root
t
what version of harvester?
b
1.35V
t
odd. you should be able to use kubectl to see the “cluster”
b
image.png
is there any service that i can restart?
t
looks like the whole node is having issues. looks like k8s is not working either. Is this a single node install or multi?
b
this is multi (cluster)
t
AH. more than 3 nodes?
You should be able to get to the gui on one of the master nodes.
b
i have 3 nodes
this is second node
t
ok can you get to the gui of that node?
go to the node ip and not the mgnt one.
b
I'm unable to log in - 404 error is coming and vanishes in seconds
t
ssh into that node and run
kubectl get node
as root.
b
image.png
t
OK. did you get a cert error from the gui? You can update it from the settings command. I would reboot node1 to see if it comes back. you may have multiple problems.
b
i have restarted one testing server, and it is working. but some VMs are running, which i didn't take the backup
t
k
b
is there any other way to restart the services?
t
systemctl status rke2-server.service
will show you the status of the rke2 service.
journalctl -xefu rke2-server.service
will get you logs
b
logs rke2.txt
t
yup that is a cert issue. Update the cert on a good node and then reboot.
b
sure, let me try.
Copy code
# Please edit the object below. Lines beginning with a '#' will be ignored,                                                                                                                                    
# and an empty file will abort the edit. If an error occurs while saving this file will be                                                                                                                     
# reopened with the relevant failures.                                                                                                                                                                         
#                                                                                                                                                                                                              
apiVersion: <http://harvesterhci.io/v1beta1|harvesterhci.io/v1beta1>                                                                                                                                                                            
default: '{}'                                                                                                                                                                                                  
kind: Setting                                                                                                                                                                                                  
metadata:                                                                                                                                                                                                      
  annotations:                                                                                                                                                                                                 
    <http://harvesterhci.io/hash|harvesterhci.io/hash>: d14a028c2a3a2bc9476102bb288234c415a2b01f828ea62ac5b3e42f                                                                                                                             
  creationTimestamp: "2024-07-27T16:07:44Z"                                                                                                                                                                    
  generation: 2                                                                                                                                                                                                
  name: ssl-certificates                                                                                                                                                                                       
  resourceVersion: "6797"                                                                                                                                                                                      
  uid: 14a38dbb-3e49-4972-a88b-9d9d12c67c69                                                                                                                                                                    
status:                                                                                                                                                                                                        
  conditions:                                                                                                                                                                                                  
  - lastUpdateTime: "2024-07-27T16:07:44Z"                                                                                                                                                                     
    status: "False"                                                                                                                                                                                            
    type: configured                                                                                                                                                                                           
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
"/tmp/kubectl-edit-3386199985.yaml" 20L, 641B
This is in the second node
t
check the third. wait did you ever assign a cert and key to the cluster from the gui?
b
yes, i have uploaded in the both in the Management IP- UI
t
ok, check the third.
b
Copy code
# Please edit the object below. Lines beginning with a '#' will be ignored,                                                                                                                                    
# and an empty file will abort the edit. If an error occurs while saving this file will be                                                                                                                     
# reopened with the relevant failures.                                                                                                                                                                         
#                                                                                                                                                                                                              
apiVersion: <http://harvesterhci.io/v1beta1|harvesterhci.io/v1beta1>                                                                                                                                                                            
default: '{}'                                                                                                                                                                                                  
kind: Setting                                                                                                                                                                                                  
metadata:                                                                                                                                                                                                      
  annotations:                                                                                                                                                                                                 
    <http://harvesterhci.io/hash|harvesterhci.io/hash>: d14a028c2a3a2bc9476102bb288234c415a2b01f828ea62ac5b3e42f                                                                                                                             
  creationTimestamp: "2024-07-27T16:07:44Z"                                                                                                                                                                    
  generation: 2                                                                                                                                                                                                
  name: ssl-certificates                                                                                                                                                                                       
  resourceVersion: "6797"                                                                                                                                                                                      
  uid: 14a38dbb-3e49-4972-a88b-9d9d12c67c69                                                                                                                                                                    
status:                                                                                                                                                                                                        
  conditions:                                                                                                                                                                                                  
  - lastUpdateTime: "2024-07-27T16:07:44Z"                                                                                                                                                                     
    status: "False"                                                                                                                                                                                            
    type: configured                                                                                                                                                                                           
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
~                                                                                                                                                                                                              
"/tmp/kubectl-edit-1687201104.yaml" 20L, 641B
third one
t
Check
kubectl get secret -n cattle-system tls-ingress
b
Copy code
kubectl get secret -n cattle-system tls-ingress                                                                                                                      
E0730 18:05:20.770735  221053 memcache.go:265] couldn't get current server API group list: Get "<https://127.0.0.1:6443/api?timeout=32s>": dial tcp 127.0.0.1:6443: connect: connection refused                  
E0730 18:05:20.770899  221053 memcache.go:265] couldn't get current server API group list: Get "<https://127.0.0.1:6443/api?timeout=32s>": dial tcp 127.0.0.1:6443: connect: connection refused                  
E0730 18:05:20.772257  221053 memcache.go:265] couldn't get current server API group list: Get "<https://127.0.0.1:6443/api?timeout=32s>": dial tcp 127.0.0.1:6443: connect: connection refused                  
E0730 18:05:20.772723  221053 memcache.go:265] couldn't get current server API group list: Get "<https://127.0.0.1:6443/api?timeout=32s>": dial tcp 127.0.0.1:6443: connect: connection refused                  
E0730 18:05:20.773988  221053 memcache.go:265] couldn't get current server API group list: Get "<https://127.0.0.1:6443/api?timeout=32s>": dial tcp 127.0.0.1:6443: connect: connection refused                  
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?
t
from the second node.
b
Copy code
kubectl get secret -n cattle-system tls-ingress                                                                                                                                                
NAME          TYPE     DATA   AGE                                                                                                                                                                              
tls-ingress   Opaque   2      368d
t
I am trying to figure out if the it is RKE on the node or the cluster ingress certs that are causing the issue.
b
i have restarted the rke2-server
Copy code
systemctl restart rke2-server
t
what is the status?
kubectl status rke2-server
?
b
its up and running & im able to access the UI as well
t
ok cool..
b
Thank you so much for your help 🙂
t
any time
👍 2