I've just come across Harvester and currently am working at a small PoC for use with our clients. VM use case is pretty clear. I'm trying to launch a VM with a container disk which is a docker hub image. It seems to retrieve the image fine:

Pod virt-launcher-test-pvmxs
Successfully pulled image "caddy" in 1.962105163s

But then getting SyncFailed with

VirtualMachineInstance test
Failed to find a sourceFile in containerDisk disk-1: Failed to check /proc/1/root/run/k3s/containerd/io.containerd.runtime.v2.task/k8s.io/13063f6d1ce116f91752acae7c1157bee4fad81c54d82a8ca6cd230e3bd7aa95/rootfs/disk for disks: open /proc/1/root/run/k3s/containerd/io.containerd.runtime.v2.task/k8s.io/13063f6d1ce116f91752acae7c1157bee4fad81c54d82a8ca6cd230e3bd7aa95/rootfs/disk: no such file or directory

It looks to me like this use case (while not documented as far as I can find), should work. What am I doing wrong?

For the harvester VM pools (created via rancher), does harvester manage OS updates automatically?

Team, How we can assign static IP for the VM in Harvester. I tried with cloudinit but didn't work

Hey. I am running a 3 node Harvester Cluster version 1.0.3 and have currently installed a number VMs, installation is going ok but when up an running there seems to be

stagnation in the VMs, performance isn't as good as other KVM installations eg. Proxmox. I am trying to find some tuning documentation but non to find. Any help would be appreciated.

We are hosting a Global Online Meetup for Harvester on October 26. We will be doing this meetup live from KubeCon NA and if you are not going to be at KubeCon NA this year you can sign up here and see the event online.

To test disaster recovery we tried to re-create the first Harvester node of a 3-node-cluster (delete and reinstall). It didn't work and created a new single-node cluster. The same procedure was working for the other nodes... I could imagine this doesn't work because of the "first node" of the underlying RKE2, but Harvester might have a workaround. Is this supposed to work? How? If not, why it's not documented?

Is

dmesg

from boot time stored anywhere in the Harvester file-system? I'm wanting to see some messages from boot time but they've dropped out of the ring-buffer of

dmesg

, and I don't want to reboot the node just now. Thanks.

Hi #harvester I have a issue when staging a new k8s cluster with rancher with the harvester rke2 driver. I always get the following error:

apiVersion: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
kind: Machine
metadata:
  annotations:
    <http://machine.cluster.x-k8s.io/exclude-node-draining|machine.cluster.x-k8s.io/exclude-node-draining>: "true"
  creationTimestamp: "2022-10-11T06:41:26Z"
  deletionGracePeriodSeconds: 0
  deletionTimestamp: "2022-10-11T06:42:03Z"
  finalizers:
  - <http://machine.cluster.x-k8s.io|machine.cluster.x-k8s.io>
  generateName: test4-pool1-865b474845-
  generation: 3
  labels:
    <http://cattle.io/os|cattle.io/os>: linux
    <http://cluster.x-k8s.io/cluster-name|cluster.x-k8s.io/cluster-name>: test4
    <http://cluster.x-k8s.io/control-plane|cluster.x-k8s.io/control-plane>: "true"
    <http://cluster.x-k8s.io/deployment-name|cluster.x-k8s.io/deployment-name>: test4-pool1
    machine-template-hash: "4216030401"
    <http://rke.cattle.io/cluster-name|rke.cattle.io/cluster-name>: test4
    <http://rke.cattle.io/control-plane-role|rke.cattle.io/control-plane-role>: "true"
    <http://rke.cattle.io/etcd-role|rke.cattle.io/etcd-role>: "true"
    <http://rke.cattle.io/rke-machine-pool-name|rke.cattle.io/rke-machine-pool-name>: pool1
    <http://rke.cattle.io/worker-role|rke.cattle.io/worker-role>: "true"
  managedFields:
  - apiVersion: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
    fieldsType: FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .: {}
          f:<http://machine.cluster.x-k8s.io/exclude-node-draining|machine.cluster.x-k8s.io/exclude-node-draining>: {}
        f:finalizers:
          .: {}
          v:"<http://machine.cluster.x-k8s.io|machine.cluster.x-k8s.io>": {}
        f:generateName: {}
        f:labels:
          .: {}
          f:<http://cattle.io/os|cattle.io/os>: {}
          f:<http://cluster.x-k8s.io/cluster-name|cluster.x-k8s.io/cluster-name>: {}
          f:<http://cluster.x-k8s.io/control-plane|cluster.x-k8s.io/control-plane>: {}
          f:<http://cluster.x-k8s.io/deployment-name|cluster.x-k8s.io/deployment-name>: {}
          f:machine-template-hash: {}
          f:<http://rke.cattle.io/cluster-name|rke.cattle.io/cluster-name>: {}
          f:<http://rke.cattle.io/control-plane-role|rke.cattle.io/control-plane-role>: {}
          f:<http://rke.cattle.io/etcd-role|rke.cattle.io/etcd-role>: {}
          f:<http://rke.cattle.io/rke-machine-pool-name|rke.cattle.io/rke-machine-pool-name>: {}
          f:<http://rke.cattle.io/worker-role|rke.cattle.io/worker-role>: {}
        f:ownerReferences:
          .: {}
          k:{"uid":"8f9a6787-89ae-467f-9b8a-04c5d1c166df"}: {}
      f:spec:
        .: {}
        f:bootstrap:
          .: {}
          f:configRef: {}
          f:dataSecretName: {}
        f:clusterName: {}
        f:infrastructureRef: {}
    manager: rancher
    operation: Update
    time: "2022-10-11T06:41:31Z"
  - apiVersion: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
    fieldsType: FieldsV1
    fieldsV1:
      f:status:
        .: {}
        f:bootstrapReady: {}
        f:conditions: {}
        f:failureMessage: {}
        f:failureReason: {}
        f:lastUpdated: {}
        f:observedGeneration: {}
        f:phase: {}
    manager: rancher
    operation: Update
    subresource: status
    time: "2022-10-11T06:42:02Z"
  name: test4-pool1-865b474845-bhk7d
  namespace: fleet-default
  ownerReferences:
  - apiVersion: <http://cluster.x-k8s.io/v1beta1|cluster.x-k8s.io/v1beta1>
    blockOwnerDeletion: true
    controller: true
    kind: MachineSet
    name: test4-pool1-865b474845
    uid: 8f9a6787-89ae-467f-9b8a-04c5d1c166df
  resourceVersion: "13374690"
  uid: 217dcecf-f7c4-4a54-9f53-090ac0ea26b2
spec:
  bootstrap:
    configRef:
      apiVersion: <http://rke.cattle.io/v1|rke.cattle.io/v1>
      kind: RKEBootstrap
      name: test4-bootstrap-template-txtdb
      namespace: fleet-default
      uid: 90b842bb-88e3-42e1-a855-062474e7885a
    dataSecretName: test4-bootstrap-template-txtdb-machine-bootstrap
  clusterName: test4
  infrastructureRef:
    apiVersion: <http://rke-machine.cattle.io/v1|rke-machine.cattle.io/v1>
    kind: HarvesterMachine
    name: test4-pool1-dfa3df5a-tdqqf
    namespace: fleet-default
    uid: 919260c8-30f3-4bed-b7f4-ce1947024b18
status:
  bootstrapReady: true
  conditions:
  - lastTransitionTime: "2022-10-11T06:41:31Z"
    status: "True"
    type: Ready
  - lastTransitionTime: "2022-10-11T06:41:31Z"
    status: "True"
    type: BootstrapReady
  - lastTransitionTime: "2022-10-11T06:42:04Z"
    message: deleting server [fleet-default/test4-pool1-dfa3df5a-tdqqf] of kind (HarvesterMachine)
      for machine test4-pool1-865b474845-bhk7d in infrastructure provider
    status: "False"
    type: InfrastructureReady
  - lastTransitionTime: "2022-10-11T06:42:03Z"
    reason: Deleting
    severity: Info
    status: "False"
    type: NodeHealthy
  - lastTransitionTime: "2022-10-11T06:42:03Z"
    status: "True"
    type: PreTerminateDeleteHookSucceeded
  failureMessage: "Failure detected from referenced resource <http://rke-machine.cattle.io/v1|rke-machine.cattle.io/v1>,
    Kind=HarvesterMachine with name \"test4-pool1-dfa3df5a-tdqqf\": Downloading driver
    from <https://cloud.buttahtoast.ch/assets/docker-machine-driver-harvester>\nDoing
    /etc/rancher/ssl\ndocker-machine-driver-harvester\ndocker-machine-driver-harvester:
    ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, stripped\nTrying
    to access option  which does not exist\nTHIS ***WILL*** CAUSE UNEXPECTED BEHAVIOR\nType
    assertion did not go smoothly to string for key \nRunning pre-create checks...\nError
    with pre-create check: \"Get \\\"<https://cloud.buttahtoast.ch/k8s/clusters/c-m-rjpmz6q4/apis/harvesterhci.io/v1beta1/settings/server-version>\\\":
    x509: certificate signed by unknown authority\"\nThe default lines below are for
    a sh/bash shell, you can specify the shell you're using, with the --shell flag."
  failureReason: CreateError
  lastUpdated: "2022-10-11T06:42:03Z"
  observedGeneration: 3
  phase: Deleting

I already added the letsencrypt cert to rancher with no luck. Can anybody help me? I can also give someone access to the cluster If they want to test something. Im running rancher 2.6.8 & harvester 1.0.3 Thanks & Cheers, Kevin

wanting to play around with the harvester and rancher integration as a home lab box (used to use esxi as I'm a VCP but thought this would be quite the vmware killer setup). Anyways, harvester 1.0.3 with single node rancher 2.6.6 as a VM on/in harvester... I have a focal-server-cloudimg-amd64.img in harvesters image repo. I have integrated harvester into rancher and trying to deploy a new RKE2 cluster but when I try to select the node pool image to use I get, "Sorry, no matching options" and there is an error on the page saying "cluster.management.cattle.io "v1" not found. Any ideas hive mind?

any pointers on how i can set timezone of my nodes after already forming a cluster? also, is there a way to prevent vms from syncing time with the host? (windows vms specifically)

Team, Is it possible to change format to include dot in display name ?

admission webhook "virtualmachine-validator.kubevirt.io" denied the request: spec.template.spec.hostname does not conform to the kubernetes DNS_LABEL rules : a lowercase RFC 1123 label must consist of lower case alphanumeric characters or '-', and must start and end with an alphanumeric character (e.g. 'my-name', or '123-abc', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?')

any pointers on how i can set timezone of my nodes after already forming a cluster? also, is there a way to prevent vms from syncing time with the host? (windows vms specifically)

Hi Team, Hoping someone can point me in the correct direction. Im wanting to use Harvester to replace VMWare in my future datacenters. Ive setup a homelab cluster and the biggest issues I notice with Harvester (for the use of my staff/business) are around Backups. Specifically want to see the ability to snapshot VM’s for updates and the ability to connect Enterprise Backup systems (Veeam specifically) to able to run scheduled backups of the VM’s. What is everyone else doing in this space as its a bit of a dealbreaker at the moment. Cheers All!

Good morning, I am having an installation issue. The installer insists that both network interfaces are down. when installing any other os(vmware for instance) only the secondary interface is down. I was wondering if anyone had thoughts on what might be causing this?

How we can change no. of replica's of volume in longhorn ? I changed via GUI but didn't take effect yet

Even after setting default replica count 2, its creating 3 replica's. How we can fix it ?

Team: Any idea from where I can download the kubevirt-->VirtualMachine CRD? Thanks in Advance!!

Team: We used to have an API docs in the Harvester Site. I am not finding anymore. Anyone know the new location?

My harvester node is not importing into my Rancher instance. I can ping the IP of rancher from Harvester node. Where can see the connection logs between Rancher and Harvester?

Is any way, we can share one harvester VM disk to another VM ?

Hello, I'm trying to build a 3-node Harvester HCI setup. As soon as I add the 3rd node, 2nd node goes to cordoned/Unavailable state (Kubelet stopped posting node status). Any thoughts?

Is there a way to import/unhide the local/upstream Harvester K8s cluster in Rancher?

cc @prehistoric-balloon-31801 @red-king-19196

Harvester v1.1.0 has now been released! https://github.com/harvester/harvester/releases/tag/v1.1.0

Anyone know where harvester stores the downloaded images used to deploy VMs? I would like to manually pull in an image from another server to harvester server

Wanting to check out the new 1.1 release on a single node and am stuck at: