and you are missing a point, that every unit that removes Wanderers o resets it to 1 pwr, is more powerful and grants points advantage.You are missing one of the most important aspect of your suggestion. You are basically saying "He goes tall and there are all kinds of tall punish cards", but you are missing the point that, the opponent has to PLAY a card to counter this card which just comes to board for free. Your argument would make sense if Sunset Wanderer comes to board and skips the turn.
for example Bloody Baron - a perfectly versalite card with big body - a complete power swing.
same for Morkvarg Pirate, or every witcher, even like Axii - an autoinclude in Skellige control nowadays.
so - the most powerful control Skellige, or many control/tempo Northern Realms, already autoinclude at least 1 card, that completely obliterates Sunset Wanderers points