hello everyone i'm having an issue upgrading from v1.0.3 > v1.1.1. i have a node stuck in pre-drain, but i cant figure out how to get it to move forward. i have 4 nodes, it finished one now w/o issue, but it's stuck on pre-drain for the second node, i cant figure out why, and if i try to pull logs, i just get timeouts.

NAME           STATUS                     ROLES                       AGE   VERSION
harvester-01   Ready,SchedulingDisabled   control-plane,etcd,master   91d   v1.22.12+rke2r1
harvester-02   Ready,SchedulingDisabled   control-plane,etcd,master   92d   v1.22.12+rke2r1
harvester-03   Ready                      control-plane,etcd,master   92d   v1.24.7+rke2r1
harvester-04   Ready                      <none>                      60d   v1.22.12+rke2r1

NAME                                         COMPLETIONS   DURATION   AGE
harvester-promote-harvester-01               1/1           97s        91d
harvester-promote-harvester-02               1/1           109s       91d
hvst-upgrade-gnpg4-apply-manifests           1/1           10m        69m
hvst-upgrade-gnpg4-post-drain-harvester-03   1/1           6m1s       57m
hvst-upgrade-gnpg4-pre-drain-harvester-02    1/1           11m        40m
hvst-upgrade-gnpg4-pre-drain-harvester-03    1/1           6s         59m

Hi @quaint-alarm-7893, could you check the

hvst-upgrade-gnpg4-pre-drain-harvester-02

logs? From your node status, it looks like you may meet this issue, https://docs.harvesterhci.io/v1.1/upgrade/v1-0-3-to-v1-1-1#2-an-upgrade-is-stuck-when-pre-draining-a-node-case-2. It also has some suggestions for upgrading when hit this issue.

Thanks @salmon-city-57654 i wasnt able to look at the logs because every time i tried, i'd get a timeout error.

OK, sounds good 🎉!! If you meeting any problems after upgrading. Feel free to create new posts on the channel😁 BTW, which node did you reboot?

node 2