I just need a little moment to vent!

Tonight I went saw a work colleague at a meeting. We both have two year old boys, just a few months apart. I asked him how his LO was doing and he said he's talking up a storm and at a fun age. I replied that our LO had recently started talking a ton and we were especially excited because he has had a bit of a speech delay and agreed it is so much fun to know what is going on in their little heads as they talk more and more. Then my colleague replied that it wasn't really surprising (LO's speech delay) because my DH and I aren't big talkers. I didn't really know how to respond to this and I honestly don't think he meant anything harmful by it, but my mama feelings are hurt!

Obviously in future I will not qualify my response and simply say "oh yeah, my kid's talking a lot too, it is fun", but for tonight I'm feeling upset that anyone would think that LO's delay is even remotely my fault. We spend hours every week in therapy, I have talked and read to LO a ton every day since he was born, I take him to classes, etc.

Anyone else ever wish they could have a conversation do-over?