The reply to my own question. User error. I enabled both Remote Desktop (RDP) and Remote Login (VNC). That put Gnome listening to port 3390, and the attempted RDP login on 3389 being confused with VNC. Changing the RDP client to use 3390, and opening 3390 in the firewall, all is good.