By any chance, is your husband an introvert? Does he like to spend time alone on a regular basis even if he enjoys spending time with you. Although I don’t have kids yet, I can feel the way your husband feels if I don’t get enough “alone time” in my life. If he’s an introvert, see if giving him some space to pursue his solidary activities on a regular helps.