If I may be so bold... address this RIGHT NOW with him.
I myself closed off from my wife for a long time due to health issues that I hid from her, feeling like I was burdening her with more stress related and financial related things than she needed. She closed off from me during that time, hiding an emotional relationship with a married man, that then gave way to an extensive affair.
I am NOT saying that you or your husband are in any way in that boat, just that from my own personal life experience, it happens... and my wife has shown me and our 3 boys how disturbingly easy it can be.
Address this RIGHT NOW! Men and women are NOT on the same page when it comes to our "needs"... When women list their top 5 items for what they need as compared to a man listing his top 5, they are in most cases not even close.
Women value (in general, NOT all women)
Affection
Intimate Communication
Honesty and Openness
Financial Support
Family Commitment
Men value (in general, NOT all men)
Sexual Fulfillment
Recreational Companionship
Physical Attractiveness
Domestic Support
Admiration
Again, these are generalizations... not set in concrete or stone descriptions of all people. But I FIRMLY agree that men and women prioritize their needs MUCH differently, and as a result, it is easier for some to fall prey to trouble and distance in a marriage... and ultimately run the VERY high risk of an affair taking place to fill that "need" in one spouse or another.
Please forgive my being blunt, but as I have said now a few times, this absolutely NEEDS to be addressed RIGHT NOW. If my wife had come to me with questions of why I was being distant, rather than the constant berating me for not participating, if I had felt the sharing of my health issues wouldn't be met with disdain or harsh criticism, if there were the suggestion of counseling to assist us through the gap that had widened... if, If, IF!!!!
DO NOT LET THIS HAPPEN!!! Fight for your marriage! I fought as HARD as I could, but she was already gone, she had checked out of our marriage years ago, and is comfortable with the choices she has made. Believe me when I say that it is devastating to hear those words come from your spouse, THE ONE person that you would have done anything for, only to find YOU are not that one person for them in their heart. It is devastating.
Address this between your husband and yourself, get counseling right now. He may get upset saying that there isn't a need, that there isn't time, or that there isn't money. Your marriage, my marriage, ANY marriage, should be the ONE THING that is worth fighting for.
Now... go fight for your marriage with everything that you have.
Have a blessed day,
-emptymailbag