Never mind. I forgot to give the --cluster-cidr flag to the second master as well