... What do you do? (And what age is your visitor?)

My son will be 4 in a few months. He comes to our room with some frequency, either climbing into bed without my noticing or he will ask us to come to his room and lie there for awhile. My husband is quite strict and will take him back and return after a couple of minutes. Sometimes my son will refuse to go back so my husband will tell him he can sit on the floor or go to his timeout area and sit. But, I am a softie and I feel sorry for him. We are now trying to come up with a policy! FWIW he shares a room with his little sister but she's in a crib still.