How do you keep your toddler from taking the pacifier all the time?

C never took a paci, even as a baby, so I know it's not that she actually wants it. But anytime she spots it she grabs it- and I have to have it within reach to give the baby sometimes. It wouldn't be so bad if she didn't have a cold and constant runny nose. I hate yelling and prying it from her hands all the time but it's driving me crazy!