Yes and no. This is just what devs have difficulty balancing when trying to make crafting worth the players time. Crafting requires buying maps, treasure hunting, then having the materials to craft with. There is a much higher cost for crafting in both time and materials, than there is for just killing a mob and looting its corpse, or opening a treasure chest. The effort that goes into crafting should reward the player with something worth their time, otherwise you will get crafting that is useless.
The problem is, there aren't many good looking non-witcher armors in game. That is just an opinion, but I think if they made more good looking armors that couldn't be crafted, people would be much happier to search for them and loot them, rather than crafting witcher armors. Its all about appearances and/or stats, and right now, crafted witcher sets both look better and have better stats, so most people are willing to go through the effort to craft each tier of their witcher gear.