Help

So I’ve been seeing a guy (we both have kids, he’s got one). I have a 1 year old and just gave birth (he was at delivery instead of the dad which speaks volumes). We all get along very well (his son is older but very accepting and sweet but I’m afraid it’s not going to work out. The father of my children left me for a 24 year old (said he wasn’t “allowed” to be at delivery), goes through our conversations, etc. I just don’t want this same bs to go down again and it’s effecting the way I perceive my new man. He’s done so much for my kids and I already, is flying in my mom for the holidays, and so many other amazing things. I guess I’m asking should I leave or at least be suspicious?