This message was deleted.

A lot to unpack here.

Thank you, apologies about the terminology mix up. I'm trying to absorb so much currently and I'm not going to lie... This job is way above my knowledge level. But they oddly seem to be happy with me (I have been honest with them about my shortcomings). I am trying to balance the view points of this engineer with the opinions I had formed to date with regards to best practices; which I was coming from the view of using pre made tools, rancher, harvester etc to get the results we want. BUT this engineer is far more knowledgeable than I, so I do not want to discount his opinion. I think he has had a couple of issues with rancher previously and also is concerned/not a fan of suse although he is willing to trial it out. To me having an engineer critical of a product is going to be a huge asset as if he changes his mind then we are definitely on the right track. I have just submitted a PO for 3 new nodes of pretty decent spec with the safety net of being able to repurpose them for proxmox use if the harvester idea doesn't work out as I hope. Essentially I have been given the task to explore and suggest a new full stack for our k8 infra. Which is pretty much a dream situation to be in; I am just trying to balance everything out and due to my lack of hands on experience with all these components it is hard to evaluate them all, but soon we will have a couple of test environment for our engineers to play around with.

I have been in the tech industry for a LONG time. Too many times we have STRONG opinions about things that may no longer be valid. The software gets better. The hardware gets better. This is where playing and testing is important and fun. Play with harvester and rke2. Show him what it can do now.

fwiw we do ~all harvester management via API. the GUI is basically just doing the same API calls over xhr

This is music to my ears. Honestly thank you. I know we are talking in a rancher/harvester community so I do expect some levels of bias, but I think I also need to accept that the engineer in question may not know the full picture at this stage. @prehistoric-morning-49258 may I ask for a rough top-level view of what this looks like? No need to go into details but some some breadcrumbs to point me in the right direction would be greatly appreciated

share your code! lol

Noooo 😆 no need to share code or anything.. That would take the fun out of it, just quick overview of tools used (teraform/opentofu vs direct API calls etc)

yeah we have a fairly idiosyncratic setup, but essentially harvester is just kubevirt+longhorn+tools on immutable OS, so I don't think much point rolling your own. we just use REST API directly, usually find docs/examples or just setup via GUI and then check what it's doing. kubevirt docs are also helpful w/ minor differences

@prehistoric-morning-49258 you are a wonderful human, this is pretty much the confidence boost I needed. I think I may suggest we separate the VM/HCI layer away from the workload layer internally as their current workflow for cluster management and workloads are in one repo/pipeline.