I don't feel that wanting another child is reason enough for divorce, especially if that is the only "problem." One thing is unless you are extremely wealthy and have hundreds if not a thousand plus dollars extra every month, it will never feel like you can afford another child. This is a moment where there isn't a real compromise - you can't have half a kid, so only one of you is only going to get what they want. Have you shown him how you can afford another? Is he doing anything about his severe anxiety? Whether or not y'all have another child, he needs to address the anxiety and any other issues.
Just give it time. 35 is still young x
Maybe come up with a plan to earn money to afford a second child. Food will cost more, activities and possibly schooling but often they can reuse clothing and toys. Housing and car costs don’t increase. Have you asked him what specifically he’s worried about financially? Is it baby costs? Future stuff? College?
I'm just giving my opinion please don't take it negatively. Unless there's abuse or infidelity. You should not leave a marriage under any circumstances. til death do us part and vows are sacred and through thickness and thin especially when children are involved. Keeping a family together is most important. kids deserve full everyday access to both their biological parents in the same household. I repeat as well unless there's cheating or abuse. also including respecting each other's wants especially in this case if your husband thinks as a family you guys aren't financially prepared for another. Could you imagine if he had similar thoughts if you didn't want something during a particular time. I truly hope all works out!