I have a multiple kubernetes cluster.
And I want longhorn to be scheduling volumes for my containers, and running all of the longhorn components on all my nodes except for this one node, we will call it “node-no-longhorn”
What I did:
1. I set a node label on all the nodes I want all my longhorn components to run on, and then I edited all the longhorn components deployments, daemon sets etc… so that longhorn components only schedule on nodes with this set node selector/label.
And I did not label my “node-no-longhorn“
And I don’t see any longhorn components running on the node “node-no-longhorn” which is good
2. Also, I set a totally different label, this time only on the node “node-no-longhorn”,
and for all my all container deployments, I set a required node affinity of “Not In” and the node label, so all my containers are required to not run on the node with this label…..and the node with the label is “node-no-longhorn”
3. I didn’t even install open-iscsi package onto this node “node-no-longhorn”
The problem is, for some reason , this one volume of one of my containers keeps wanting to be scheduled onto “node-no-longhorn” so all my work is for naught and I suck.
How would I correctly go about configuring Longhorn so it does not stun any longhorn components on this specific node, and how can I also make it so longhorn never tries scheduling volumes on this node.
Also, Do I have to install open-iscsi onto this node that I don’t want longhorn using at all?
Thanks guys