There should be simple "hold speed" -button like holding down shift key while driving and the car stays at the speed it's currently at.
Maybe have a separate slider how sensitive the inputs are when holding the key.
Very similar to the "cruise control" already suggested.