This message was deleted.
# harvestera
adamant-kite-43734
11/04/2023, 5:03 PMThis message was deleted.
s
salmon-bear-45866
11/04/2023, 6:32 PMAfaik not possible, at least via terraform per https://github.com/rancher/terraform-provider-rancher2/issues/1030. If you do find a way, I'd love to know!
b
blue-kitchen-51801
11/04/2023, 8:28 PMmost likely we can automate this by updating each VM manifest (which is of type kubevirt.io.virtualmachine) following https://kubevirt.io/user-guide/virtual_machines/host-devices/#preparation-of-mediated-devices-such-as-vgpu
blue-kitchen-51801
11/04/2023, 8:30 PMto fully automate this is it possible to create a Harvester Addon that will run a CronJob to assign the right PCI device to each VM
w
witty-megabyte-20434
11/05/2023, 12:50 AMafaik full vGPU's are not available yet in harvester right? We currently need to fully assign a PCI GPU device to an individual VM.
witty-megabyte-20434
11/05/2023, 12:51 AMWould be neat if we could have an admission controller modify the vm spec before it gets created. This way the VM would boot up immediatly with the correct gpu attached to it
👀 1
m
most-holiday-75301
11/06/2023, 6:14 PMhttps://github.com/inaccel/cloud-init/blob/master/internal/mutate.go
Our workaround is to mutate VMIs based on the cloud config in user data.
For example, you add the following cloud config in the user data of a node pool and the webhook adds the respective host devices in the VMI spec:
most-holiday-75301
11/06/2023, 6:15 PM Copy code
inaccel:
<http://nvidia.com/GP102GL_Tesla_P40|nvidia.com/GP102GL_Tesla_P40>: 1most-holiday-75301
11/06/2023, 6:16 PMThere's also a controller that detects user data changes in a VM spec.
most-holiday-75301
11/06/2023, 6:19 PMWe might consider packaging this functionality as a Harvester addon. Currently, that's how we deploy it in Harvester: https://github.com/inaccel/helm/tree/master/charts/fpga-cloud
🙌 2
g
great-bear-19718
11/30/2023, 10:30 PMwe do have work in progress to allow vgpu to be added a resource during VM creation via rancher
❤️ 1
great-bear-19718
11/30/2023, 10:30 PMthis is targetted for 1.3.0: https://github.com/harvester/docker-machine-driver-harvester/pull/50
s
salmon-bear-45866
11/30/2023, 10:31 PM💯 awesomeness!