Just curious... If you're in a group setting, and everyone's passing your baby around, how do you get your baby back?

I would feel kind of mean just taking them from someone, but absent a diaper change or feeding, what reason do you give for taking back LO?