Sex while sick?

Hi ladies, I’m having a bit of a dilemma over the prospect of having sex with my husband while sick (common cold, not morning sickness). For some context, before we got pregnant sex was happening at least 3-4 times a week, sometimes we would go twice in one day. We were *very* active. After getting pregnant and having some complications/scares, it feels as though we are doing it once a week, if that. And I just caught myself thinking that we haven’t done it since Monday and I know he is probably really craving it (though he’s considerate enough not to have said anything), and I also could use that intimacy, because I frankly do miss the dynamic we used to have. But because of this cold I’m worried that I may be putting my baby at risk. Everything I am reading online says to put off sex and rest until I am better, but my mind is still fighting that. I want to and I’m worried about wanting to at the same time… does that make sense? I don’t know what the point of this post is, other than to ask if anyone has ever been in a similar situation and how you dealt with it.