I don't like being naked when I'm not in bed or the shower; the feeling of drafts and cold surfaces on my skin bothers me.
A similar collection of distractions has turned me into a robe guy. I rarely sit around without something "over," but inside the robe is freedom and pleasure.
It's not the same, but it feels good.