Short answer is no. Long answer is Harvester will be installed the same on all nodes, it's just the first 3 nodes, regardless of spec, will be management nodes. Longhorn is req'd for Harvester. If you had another 2 witness nodes you might be better off installing Harvester on 3 witness nodes first then adding your ample nodes.