Yes I've been through this, not really the crying baby, but a partner who doesn't help. My partner really doesn't help other than putting our toddler to sleep. Just don't do the chores or things that you feel you can't. He will have to pick up the slack. My partner also has an elaborate social life and I do not. As for the baby. I would join some Facebook groups. Are you breastfeeding? It is EXTREMELY common for babies to be sensitive to dairy, soy, caffeine, eggs and even gluten/wheat in breastmilk. If the baby is upset it is mostly one of these things. Join the dairy free breastfeeding group on Facebook. And start to eliminate these items one at a time over the course of a couple weeks, give 3 days between each one to see if her symptoms improve. I would start with dairy and then wheat. Once the baby is settled it will probably improve your relationship.
You also sound like you're in a relationship where your partner doesn't just 'assume' he needs to be told. So tell him your needs, I would start with telling him he needs to move his desk into a bedroom... so you can maintain your sanity...
You need to get some scheduled me time too so its more fair. On weekends you should get a few hours for yourself. After work, he needs to immediatelly take over till bedtime so you can be alone for a couple of hours. I used to cook the dinner with my headphones in the kitchen so i wouldnt hear the crying while my husband would be with baby. Its still a chore but at least youre alone when you do it, so its a break from baby. Schedule in catch up with your friends twice a month and leave baby with him at home. Or go meet your friends midweek and take baby with you, time goes quicker when youre out and about and a good friend can take baby off your hands for a bit. You just have to prioritise yourself and demand this time for yourself. Best of luck!