But that's the thing, this wasn't present in the 1.02 version of the game. CDPR changed the spawning strategy for NPCs in the 1.03 patch for some bizzare reason.. Now many NPCs are either not present at all, or take a long time to load in.
I'm so annoyed that they felt the need to fix something that wasn't broken and have now ruined the game for me. So I'm basically stuck waiting for a new patch to fix the bugs they introduced with the last patch, it's ridiculous.
If I was on PC it wouldn't be so much of an issue since I could just download the 1.02 patch and continue playing, even if I had to start from the beginning again.