That's just not true. Whole reason why is Geralt trying to lift the curse in second chapter is because Cedric told him that it would restore his memory, also after Triss tells Geralt that she can restore his memory with rose of remembrance you can even tell Roche that you don't give s*hit about...