Health anxiety

So my baby is near 5 months old. And we have been in A&E twice with him within the last 2 months. First he had a 40 degree fever and the second he was throwing up everywhere. Not spitting up throwing up from his mouth and nose. For a good two hours. And since then I have been so stressed as soon as people around us are ill I’m stressing. Because I really don’t want him to get so poorly again. Both times when I took him A&E I was so scared. My partner said I was being extra both times that I took him to A&E. He said unless there is something extremely wrong there is no need for me to take him. But in both cases I really thought he should go to get checked. Even if we get sent home with nothing atleast i have the peace of mind that my baby is okay. It’s honestly been so stressful especially that everyone is getting ill now. Anyone else in the same boat or have any advice. Really worried mumma over here.