You'd have to make a rule that states that you can only use one or two brigades, or that you have to have at least one enhancement for each hero in the same brigade as the hero, or something like that, to ensure that someone can actually play the deck.