So i think i found the issue, game does not like afterburner overlay. Turned it off and the issue pretty much vanished. Nvidias overlay works and also asus Gpu tweek seems to not interfer. Theres some odd low frames but its not as bad as with the overlay on.
Edit:Tested some more, now the...