I found the same issue but a few people are reporting that if you use the map while in Skellige the quest triggers normally. Haven't tested that out yet because I'm taking my time with the game :3
Guys, try to use this map while on Skellige and let us now if if triggers the mission then. Can't do it myself because I have still a lot to do before travelling to Skellige. I already own the map though. And it doesnt work in Velen.