@Kirsten this!!
He is probably cluster feeding which is meant to help your supply.
He is bringing your milk supply in. Latch him as often as he needs as it will take 6-8 weeks for your milk to be fully in and stabilize to what your baby needs. If you keep giving a bottle after then your body will think it’s produced enough milk for their needs. I gave birth on the 20th and I feed on demand. It went from 1-2 hours to now 3-4 hours. I use a pacifier as well to help give my breasts a break.
Leave the bottles and let baby suckle as often as they want. Let baby build your supply.