A lot of men just don't feel comfortable handling someone so small and delicate.
Have you and your partner sat down to discuss things? Maybe he feels it's more of the woman's role to take care of the baby. Might be good to set out your expectations so that you are both on the same page. Communication is key
@Joline is 600 times a real number?
Sometimes ot gets better. I almost left my partner 600 times during the first year of our daughters life. After I started working again he came around a bit with the house work. And as our daughter got older he became more involved.