Can you provide a bit more information? For example: what guest OS, what CNI, etc.
Depending on the guest OS and CNI, you may have to make some OS adjustments (e.g. disable firewalld/UFW, adjust for Cilium route filters, disable TCP offload checksum for a VMWare issue, install and enable NFtables/IPtables for Cilium, IP forwarding for Wicked network manager, etc).