Blindsided right before vacation

There’s quite a bit of history between me and the in laws, some of which is outlined in posts. Back in the fall, we decided to spend LO’s first birthday (and mine too) at the beach – DH coordinated with his parents so we could use their vacation home, and we decided to invite both sets of parents to come up for a day/spend the night at the end of our trip. Two days before they were supposed to come, in laws told DH they were coming up a day early (reason is irrelevant). I was told this, not asked. We were supposed to have a few days as a family and they were cutting that short. I got really upset and DH and I fought, him asking me if I even wanted them coming at all. TBH, no because there has never been any apology or acknowledgement of wrongdoing, but I said yes I want them bc I thought both sets of grandparents should be there for LO’s birthday.

DH called them and they canceled their early plans and came when they were supposed to. They were a little cold (but that’s their norm) and they barely interacted with LO.

Fast forward months later to present ish day. We are supposed to take a long weekend vacation to the in laws’ vacation house (within driving distance). Husband asked me weeks ago if I could get time off for a vacation and I said yes and coordinated the time off. A few days before we leave, I make some reservations for us. I tell DH and the convo essentially goes like this

DH: did you make them for my parents too?
Me: what?!
DH: yeah, they live there.

goes outside and screams (literally, not exaggerating) I then took a walk to clear my head and think about whether I missed any hints or signs (I concluded that no, I didn’t). I returned to talk to DH…

Me: they don’t live there, they spend time there. I thought this was supposed to be a vacation with just us. And now I find out it’s two extra people and two more dogs? That’s not the vacation I anticipated.
DH: do you want to cancel?
Me: yes.

He’s barely talking to me and hasn’t been for days. I asked him if he wanted to talk about anything because he’s been ignoring me and giving one word answers and I understand he’s disappointed about canceling the vacation because he’s been looking forward to it. He said he’s not upset and not ignoring me (sure).

And on top of all that, I learned like 5 days prior to all this that I’m having fertility issues and am coordinating specialist care for that. So not a happy time right now.

I understand it probably looks bad that we canceled because I didn’t want them to be there, but I would hope DH would come up with some excuse and not throw me under the bus (e.g., it’s going to rain, something came up). We saw them for Mother’s Day and they didn’t say anything, apparently because they didn’t want to make my parents jealous. Come on.

Should I have gone along with it and hoped everything would be fine with the in laws? Maybe, but given our history I think I’m probably in the right here to protect myself and my sanity. Open to other perspectives/advice.