Making me feel crazy

Hey so I have always struggled with my LG crying. It’s really constant. Background - So basically since birth she’s cried at everything. She seems to be a really unhappy baby all the time. She’s happy sometimes but it’s really short lived. My husband is great with her and had 5 weeks off for paternity leave. As soon as he went back to work I’ve struggled to cope on my own for pretty much all of the day because he’s away for 12 hours. I get really frustrated and my patience wears thin after the crying has gone on for over an hour continuously. I’ve tried everything and motion seems to be the main thing she likes. However I draw the line at baby wearing or walking around the house after I’ve done it for 4 hours one night. I feel like she really acts up the most when it’s just me and her. I decided today after 7 weeks of crying every other day to ask my HV to come round. It’s a day where my husband is off. She came round and told me the only thing I hadn’t tried was to change the milk. I have changed the milk today and she seemed slightly better. My husband was going out at 5pm to meet friends. Cue the kick off. Anyway the point is this - the HV has basically made me feel like I’m going crazy and I have some form of mental health problems. She said maybe baby just prefers husband and that’s ok?! I agreed I need help coping and agreed to the doctor phoning me tomorrow. On reflection I am pretty annoyed now because I actually believed I am the problem. I have done nothing but love this girl and try to cuddle hold and love her like he does and it’s never helping. I’ve done all the things she likes. I’ve been made to feel like it’s me that’s the problem or I’m crazy I feel like there’s a reason babies cry excessively !!