Getting this from the droplet-operator-controller-manager

manager 2023-04-12T14:55:18.479Z    INFO    setup    starting manager                                                                                                                                                                                kube-rbac-proxy I0412 14:55:06.766959       1 main.go:186] Valid token audiences:                                                                                                                                                                    kube-rbac-proxy I0412 14:55:06.769197       1 main.go:232] Generating self signed cert as no cert is provided                                                                                                                                        kube-rbac-proxy I0412 14:55:08.329064       1 main.go:281] Starting TCP socket on 0.0.0.0:8443                                                                                                                                                       kube-rbac-proxy I0412 14:55:08.332828       1 main.go:288] Listening securely on 0.0.0.0:8443                                                                                                                                                        manager I0412 14:55:18.578008       1 leaderelection.go:243] attempting to acquire leader lease hobbyfarm/1036face.cattle.io...                                                                                                                      manager 2023-04-12T14:55:18.680Z    INFO    controller-runtime.manager    starting metrics server    {"path": "/metrics"}                                                                                                                            manager E0412 14:55:20.278445       1 leaderelection.go:329] error initially creating leader election record: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot create resource "leases" in API group "cmanager E0412 14:55:23.792964       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:28.073925       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:31.701633       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:34.762700       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:37.801964       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:41.479896       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:43.664105       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:46.060849       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:48.309806       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get resmanager E0412 14:55:51.058842       1 leaderelection.go:325] error retrieving resource lock hobbyfarm/1036face.cattle.io: <http://leases.coordination.k8s.io|leases.coordination.k8s.io> "<http://1036face.cattle.io|1036face.cattle.io>" is forbidden: User "system:serviceaccount:hobbyfarm:default" cannot get res

and this from the shim

2023-04-12T14:57:03.965Z    ERROR    controller-runtime.manager.controller.virtualmachine    Reconciler error    {"reconciler group": "<http://hobbyfarm.io|hobbyfarm.io>", "reconciler kind": "VirtualMachine", "name": "scheduled-3763911c-5f483898", "namespace": "h │
│ <http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem|sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem>                                                                                                                                                          │
│     /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.9.0/pkg/internal/controller/controller.go:253                                                                                                                                                   │
│ <http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2|sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2>                                                                                                                                                                │
│     /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.9.0/pkg/internal/controller/controller.go:214

Are these related? What's my path forward

I'm deploying from source

export IMG=hobbyfarm/droplet-operator:v0.1.3
make all
make install
make deploy

Looks like the keypair annotation is there, but the ImportKeyPair isn't created 😞

That's wrong it is there. It just can't be found when the shim is looking to create the instance. K9s couldn't see it

Is hf-shim-operator built with kubebuilder v2?

I think it originally was, but has since been upgraded.

In a haphazard way 😄

Because kubebuilder is a PITA

I cannot make today’s office hours meeting.

Hi, Thanks for creating HobbyFarm. I'm trying to install HobbyFarm in Rancher Desktop and I've documented the steps here. My end goal is to get my vCenter working with HobbyFarm and I'm still doing my research on how to define Environment and VM Templates for vCenter. Unfortunately I'm stuck now. It would be a great help if I get the specs needed for deploying VMs in vCenter.

@careful-mouse-42236 hi, I did send you a pm.

@worried-fountain-60974 👋

I can’t make it to office hours today I’m on the road

I think there are some open questions regarding our direction of microservices, grpc comms, API, etc. 1. What gets broken out into microservices? Auth I think is a good target and is in-progress. What else? Let's define that roadmap 2. gRPC comms between services - authenticated or no? I said no on today's call but I wonder if I'm wrong 3. How are we presenting a REST API to external consumers (incl. frontends)? 4. Is an API gateway necessary here or is it overkill?

Absolute newbie here with moderate experience of k3s, and decent experience of k8s. I'm working on an internal project to host katacoda like environment where we can assess candidate's knowledge and understanding of Kubernetes after completing internal Kubernetes trainnig. To achieve this objective, I came across Hobbyfarm and it appears to be a perfect solution! However, I'm kind of struggling to find some help to start deploying and setting up the system for this use-case. I"ve a VM instance available on vSphere and can easily add up more instances to make a cluster. Any quick start to setup HobbyFarm on a VM machine? Thank you community.

e2e testing: just FYI I'm doing an important rework on tests that have been added to have a clean codebase and good examples to follow, as well as avoid random issues

Automated testing: a GitHub action is now available in the e2e-testing to easily test any environment

Hi, trying to use hfcli today.

hfcli info

works but not

hfcli get

nor

apply

:

FATA[0000] the server could not find the requested resource (get <http://scenarios.hobbyfarm.io|scenarios.hobbyfarm.io> mytp)

FATA[0000] the server could not find the requested resource (post <http://scenarios.hobbyfarm.io|scenarios.hobbyfarm.io>)

Any idea ?

Hello. I could not find any docs about installing hobbyfarm with kubevirt as a vm's provider. Anyone knowns?

Hi, I have an issue with hf-shim-operator looking for droplet-operator crds when I only use ec2-operator. Where would you prefer me to create the issue on github? In the global hobbyfarm/hobbyfarm repo or in the hf-shim-operator repo?

Hi I'm in between now : • hf-shim-operator:v2.1.0, I get {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-26sdmbhged-3b0ad7b8", "namespace": "hobbyfarm", "error": "unable to find label pubKey on VM"} and now EC2 instance deployed. • hf-shim-operator:v0.2.0-rc1, instance and secret are ok but I get : {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "Operation cannot be fulfilled on virtualmachines.hobbyfarm.io \"dynamic-isintxx3c7-57d2066e\": the object has been modified; please apply your changes to the latest version and try again"} {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "Secret \"dynamic-isintxx3c7-57d2066e-secret\" not found"} {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "unable to find label pubKey on VM"} {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "VM still not running"} ... {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "VM still not running"} {"reconciler group": "hobbyfarm.io", "reconciler kind": "VirtualMachine", "name": "dynamic-isintxx3c7-57d2066e", "namespace": "hobbyfarm", "error": "Secret \"\" not found"}

Hello guys, just a quick question (I'm back from ec2-operator to terraform controller and all is fine 🙏, thanks for the job) : I see dynamic-xxx ConfigMaps and dynamic-xxx & tfstate-default-dynamic-XXX Secrets not deleted after session. Is it a defect in my installation ?

HobbyFarm v3.0.0 has been released!

I'm going to try to start again today with the installation. I hope it will be better than my last time. I couldn't finish the installation and I honestly don't know if it was due to lack of a k3s cluster or what was the reason for my errors. Thanks for your great work.

Built a new provisioner for DigitalOcean. It is meant to be a jumping off point as to how we are going to implement provisioners in the future. https://github.com/hobbyfarm/hf-provisioner-digitalocean

Feel free to play around with it. Currently requires a Gargantua image based on a PR, that's at

ebauman/gargantua:pr-154

The next few months will see work going into the machine provisioning interface for HobbyFarm, so this project will change in how it talks to HobbyFarm

but the core logic of how the droplets and keys are created should remain similar

I cannot be at the office hours today

@worried-fountain-60974 hi, I did send you a pm.