I think he likes her, but he is ashamed to admit it, because of the social views of the elves that she is a half-breed. Look at the scene in the inn when Geralt comes to meet him, anf their discussion about the "unusual tastes" of humans.
