You've mentioned that you were on Xbox One, and CDPR has already announced the plan to address the issues that exist on last-gen consoles:
Dear gamers, First of all, we would like to start by apologizing to you for not showing the game on base last-gen consoles before it premiered and, in consequence, not allowing you to make a more informed decision about your purchase. We should have paid more attention to making it play better...
forums.cdprojektred.com
In short, two patches are scheduled for January and February to address the most serious issues, and the studio is handling that as a major focus moving forward. Hopefully, we'll see some significant improvement in the look and performance of the game. (Though, as noted in the official announcement, it won't be able to achieve the same level of detail as a high-end PC or present-gen console.)
If you have any other concerns or requests, I'd recommend sending them into CDPR directly. The studio has openly acknowledged the problem.
And, I'm very sorry for your experience with the game at present. Perhaps some tips or tricks presented here will help out in the meantime. (There's a pretty magnificent game in there, if you're willing to wait for the issues to be sorted.)