You can use cluster labels as variables in fleet. Have a look at https://fleet.rancher.io/gitrepo-structure/ and look for global.fleet.clusterlables and how to use it, for example, in your helm values.yaml file. I think it should fit your use case.