Same here, but it happens not only in Skellige for me. Sometimes the music starts, the starts over again and again without playing normally. Sometimes there is no music at all. Sometimes it plays a song missing some instruments.
It seems to get triggered whenever I do something. So when I fast...