Is nested virtualization working in Harvester Trying it on P rancher-users #harvester

Title

red-queen-31013

04/29/2023, 6:03 PM

Is nested virtualization working in Harvester ? Trying it on Proxmox with enabled KVM, but getting

KVM has been disabled by BIOS. KVM must be enabled before creating any Virtual Machines.

in Harvester host.

Is nested virtualization supported for AMD ?

harvester:/home/rancher # ls -l /sys/module/kvm_amd/parameters/nested
-r--r--r-- 1 root root 4096 Apr 29 18:31 /sys/module/kvm_amd/parameters/nested

harvester:/home/rancher # lsmod | grep kvm
kvm_amd               147456  6
ccp                   106496  1 kvm_amd
kvm                  1052672  1 kvm_amd
irqbypass              16384  1 kvm

harvester:/home/rancher # egrep '(vmx|svm)' --color=always /proc/cpuinfo
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities

harvester:/home/rancher # kubectl exec virt-launcher-test-9vp9f -it bash
kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl exec [POD] -- [COMMAND] instead.
test:/ # virt-host-validate
  QEMU: Checking for hardware virtualization                                 : PASS
  QEMU: Checking if device /dev/kvm exists                                   : PASS
  QEMU: Checking if device /dev/kvm is accessible                            : PASS
  QEMU: Checking if device /dev/vhost-net exists                             : PASS
  QEMU: Checking if device /dev/net/tun exists                               : PASS
  QEMU: Checking for cgroup 'cpu' controller support                         : PASS
  QEMU: Checking for cgroup 'cpuacct' controller support                     : PASS
  QEMU: Checking for cgroup 'cpuset' controller support                      : PASS
  QEMU: Checking for cgroup 'memory' controller support                      : PASS
  QEMU: Checking for cgroup 'devices' controller support                     : PASS
  QEMU: Checking for cgroup 'blkio' controller support                       : PASS
  QEMU: Checking for device assignment IOMMU support                         : WARN (No ACPI IVRS table found, IOMMU either disabled in BIOS or not supported by this hardware platform)
  QEMU: Checking for secure guest support                                    : WARN (Unknown if this platform has Secure Guest support)
   LXC: Checking for Linux >= 2.6.26                                         : PASS
   LXC: Checking for namespace ipc                                           : PASS
   LXC: Checking for namespace mnt                                           : PASS
   LXC: Checking for namespace pid                                           : PASS
   LXC: Checking for namespace uts                                           : PASS
   LXC: Checking for namespace net                                           : PASS
   LXC: Checking for namespace user                                          : PASS
   LXC: Checking for cgroup 'cpu' controller support                         : PASS
   LXC: Checking for cgroup 'cpuacct' controller support                     : PASS
   LXC: Checking for cgroup 'cpuset' controller support                      : PASS
   LXC: Checking for cgroup 'memory' controller support                      : PASS
   LXC: Checking for cgroup 'devices' controller support                     : PASS
   LXC: Checking for cgroup 'freezer' controller support                     : PASS
   LXC: Checking for cgroup 'blkio' controller support                       : PASS
   LXC: Checking if device /sys/fs/fuse/connections exists                   : PASS

better-garage-30620

05/03/2023, 3:32 PM

and you have nested virtualization enabled on the host?

cat /sys/module/kvm_*/parameters/nested

should give you

fwiw, i'm running harvester in libvirt using nested virtualization (on intel)

red-queen-31013

05/03/2023, 6:22 PM

@better-garage-30620 yes. its enabled, but my host is EPYC based

harvester:/home/rancher # cat /sys/module/kvm_amd/parameters/nested
1

Probably some bug in 1.1.2

better-garage-30620

05/03/2023, 6:51 PM

you need to check that on the proxmox hypervisor, not on harvester

red-queen-31013

05/03/2023, 6:52 PM

of course, its enabled, have openstack running there also

👍 1

blue-kitchen-51801

05/10/2023, 7:45 PM

I also have the same issue, I’ve installed Harvester on a bare-metal server using AMD Ryzen 9 5900X 12-Core Processor

43 Views

#harvester Join Slack