At the moment, our cats are our babies. Cat tree and even litter box is in the bedroom (we live in a small townhouse).
Before baby arrives, we'll be redoing the entire bedroom and the cats will be "displaced" into the main part of the house. But I know my older 14 year old will get separation anxiety and will try to get into the bedroom.
How long did you keep your cats out of the baby room?