just noticed

--flannel-external-ip

is a server flag so I think that answers that question. its not possible to have an agent use that an have servers not use that flag. still would love pointers on whether there is some way to have servers not use external ip and have agents use external ip. i've seen a flannel node-level annotation floating around for example