If you have GeForce Experience installed, you can turn on Shadowplay, enable FPS display, position (ideally) top left, then hit Alt-F12 during gameplay to toggle its display on/off.
Don't get hung up on numbers. Sometimes it looks janky despite it being over 40fps but smooth despite it dropping below 30 fps.