Hum... I agree at the beginning, but after learning good spells and after upgrading your gear, you become almost a god.I never felt powerful with the wand, I felt kinda lame.
I'll quote @Spockprime who said it well
My biggest complaint is also one of the most enjoyable parts of the game:
Although the combat is really fun, your character is a mass killer on such a scope that even Voldemort from the books seems rather unthreatening. In addition, even though I love this from a game play perspective, your character as a 5th year student is the most powerful wizard in the world, and there doesn't even seem to be anyone else close. He/she would absolutely stomp Voldemort, and probably Voldemort and Dumbledore at the same time.