Precisely. I haven't done a heavy build yet. Did one light using Cat armor, poisons, and criticals, like I described above. Then I did a half swordsmanship / half signs build, and I used Griffin armor. Then I did multiple playthroughs using Wolf armor...just because I like that one the best.
Usually go for bleed or just maximize damage output overall with AP and runes. Fiddled with Manticore during my B&W playthrough, because: nostalgia. Last run (which I never got to finish due to my HDD dying), I used the starting armor only. Cheated and bought Nilfgaard gloves and boots. Was still going with it at around level 25.
My best, particular advice for heavy armor is: go for the one that looks best?