Okay, either I'm super unlucky in actually making the bug trigger now, I fixed it by accident, or it fixed itself?
I got a reply from support asking me to check if this still happens with DLSS and/or RTX disabled.
I turned both off and after 2 hours of gameplay (longer than usual) it appeared...