Doesn't remove them, just sheathes them. No, there isn't. Very annoying when you're trying to loot a dungeon by torchlight and you keep stowing your torch.
Also that beggar from chapter one, anyone figure it out, what does he wants? I mean he may ask for booze, but maybe it`s bad encoded and if u give food or anything else he might accept it.