I know that I get into that damned "critical listening" mode when I am in the midst of a tweak or a DIY project. That's where I don;t listen to the music itself, I listen to the highs, the lows, the soundstageing, the details, etc. Rarely does this result in fun listening.
It's only when I am mostly satisfied with the sound after the tweak, and have proven that it is indeed better and not just different, that I am able to relax and truly "listen" again for enjoyment. You are right to sit back and forget about anything else for a while. You;ve earned the break.