Explain to him his closeness is what will make you feel good in all that doesn't (If that is the case). That way at least your husband won't feel pushed away in result. You do need him in thick or thin, so try your best to keep him by your side by not misleading him when you get emotional. We humans tend to let our real emotions out in front of our nearest and dearest, mainly the one we feel the most comfortable with. That will bring some certainty to the relationship. For the rest I would strongly suggest calling your health care worker and arranging an appointment with a professional through them.
Maybe start by contacting one of the postnatal helplines. COPE is a good resource in Australia for PPD if that’s where you are. Reach out to someone in your network that you trust other than your husband, or tell him that you need his assistance in accessing resources for PPD. Make sure you make getting help for yourself a priority even if he won’t or can’t help!