You’re not doing anything wrong it’s normal sometimes babies feed off of it with you if you are stressed or feeling some type of way so they say. But no you’re not doing anything wrong being a mom is hard work sometimes you gotta try different things to find out what works for your baby and every kid is different so us moms can give you all kinds of advice but it might not even work for your baby.
Try to go to walks with him or go to parks, museum; library 📚
You are a good mom 
Being a mom is just hard
My daughter is the same, it’s because your her safe person yo be herself it’s normal
My son was the same way with me, and he still is at 3! It does get better though, because now he can express his love with words so I know that it actually just means I'm his favorite ;)
They say* baby is more fussy with mom because you are their safe space. It’s really common, don’t beat yourself up ❤️