You start with the small-ish prologue area, White Orchard, where you have to spend a couple of hours unless you rush through everything, then the big map of Velen opens up and you can go anywhere you like in there. As I understand you have to do some minor quest or pay someone for a ship ride to open up the Skellige map, but that shouldn't be a much of a hurdle.