Do you actually need to drain a node before upgrading k8s version? The docs doesn't mention anything about it.

No. Not unless you're worried about your workload being disrupted by a temporary outage of the apiserver as the control plane components are restarted.

Ok, thanks @creamy-pencil-82913!