would it ruin the friendship?

I am a horrible, anxious hostess. I will take people out to eat or go to their place, but I never have people over. I have learned that it just isn't worth the build up of anxiety.

I am open about this and most of my friends know and joke about it, but I feel like as we get older it is getting to be more irritating/hurtful to some of them
Be real, bees- is it that big of a deal?