MIL or BF?

Boyfriend of 6 years…we just had our first baby last year. Ever since getting pregnant and having the baby, my MIL specifically has made comments regarding how dumb my boundaries are. (No kissing?) and Has made it known that she does not care for me. My boyfriend admitted that he knows his mom does not like me but he never wanted to accept it. We had a sit down conversation with her regarding her attitude towards me and how I’m “burning bridges” and she told me I was attacking her and that I need to take in consideration everything she’s going through. Anyway, my boyfriend picks up our daughter after he gets off work (I work remotely from my moms house because she helps me with the baby while I work) and he takes her to his moms house without ever telling me about it. He’s mentioned that his mom feels like I am keeping our daughter from her. She feels like I should be reaching out to schedule visits. (I’m a new mom, full time employee and student) And why would I reach out if you don’t even like me? If you wanted to see her, you would ask me. Am I the a**hole to be pissed off that he takes her over there without telling me?!? I feel betrayed, like he is sneaking my daughter to someone who he knows does not like me. I feel very uneasy.