This message was deleted.
# k3s
a
This message was deleted.
c
You can try starting the servers with --disable-agent to not run containerd or kubelet, but it's unsupported. The kubelet won't really be functional without a node object anyway. Also note that if you're using embedded etcd, we need the node object to manage the etcd cluster membership, so that probably won't work right.
w
Understood, so if I'm to use --disable agent I cannot have multiple control plane nodes
c
With embedded etcd, yes. You can still use multiple servers with external SQL when disabling the agent, as that does not require node resources to coordinate.
w
Got it, I'll try with disable agent
Hey @creamy-pencil-82913 I was able to get k3s 1.21 working with
--register-node=false
. Using
kilo CNI
and
kgctl
tool I was also able to get metrics server working. I'm wondering if I can do the same with etcd.
Hey @creamy-pencil-82913 I was able to spin up a HA cluster with 3 controllers and
--disabled-agent
& embedded etcd. etcdctl shows correct etcd membership. As before my setup allows cluster & pod ip to be resolvable and reachable from the
--disabled-agent
controller nodes. Are there any gotchas I need to look out for? k3s 1.21 , kilo cni & kgctl tool on controller nodes.
l
Interested @wonderful-spring-28306. Why are you doing this? What’s the goal? And also why the old version of K3s?
w
Hey @late-needle-80860
I'm using 1.21 because this has not yet been backported to it https://github.com/k3s-io/k3s/pull/5382
l
And your setup do not support that change?
w
The ultimate goal is to have controllers without node objects hence not accesible via kubectl and impossible to schedule pods. This can obviously be achieved by using taints but having no node objects in controllers provides better isolation.
l
Okay sure. However, it sounds like that’s possible based on Brandon’s response.
w
Yes. I verified that it's possible for a single controller however metrics-server was broken. I fixed that with
kgctl
As per @creamy-pencil-82913 HA with embedded etcd should not work with
--disabled-agent
However I have also got that working so I want to know if I'm missing anything.