We’re seeing our cluster network bond (702.3ad) for VMs going down on nodes every 10th hour, e.g.

[Sat Feb 18 17:47:24 2023] device vm-bo left promiscuous mode
[Sun Feb 19 03:47:24 2023] device vm-bo left promiscuous mode
[Sun Feb 19 13:47:24 2023] device vm-bo left promiscuous mode
[Sun Feb 19 23:47:25 2023] device vm-bo left promiscuous mode
[Mon Feb 20 09:47:25 2023] device vm-bo left promiscuous mode
[Mon Feb 20 19:47:25 2023] device vm-bo left promiscuous mode
[Tue Feb 21 05:47:25 2023] device vm-bo left promiscuous mode
[Tue Feb 21 15:47:25 2023] device vm-bo left promiscuous mode
[Wed Feb 22 01:47:25 2023] device vm-bo left promiscuous mode
[Wed Feb 22 11:47:25 2023] device vm-bo left promiscuous mode

Is there anywhere within Harvester that’s useful for figuring out why this happens? The links usually go down only about a second and according to the switches we connect to, the physical links never go down. Due to the low downtime I’m not too concerned, but since we’re planning to move storage to this network I’d like to figure out the cause

Unfortunately, I don’t have a switch to check an 802.3ad config. But I don’t see this with other bond modes. Have you tried another bond mode to see if the issues also happens? Are you certain the switches are running the latest firmware? And what does the vendor of the switches say about this?

Will get the Juniper switches updated to the latest - I’m required to use 802.3ad for this but will try to set up another system using another bonding mode after verifying whether it also suffers from the same issue 👍

You can use alb - hopefully it will show you if the same issue continues.

Switched to alb, but problem remains, so filed https://github.com/harvester/harvester/issues/3744 about it 👍

I’d argue this might be a problem with the switch or the NICs + switch. We don’t see this in our hardware. Have you tried installing SLES or another Linux with a similar kernel version on that hardware?

Yeah, that’s a possibility, though we see this over two types of switches and two types of nics - the management bonds on the same machine are unaffected, but they’re also handled differently (by wickedd)