If you have an older LO did you have them stay with family the first night you were home from the hospital with the newborn?

A friend of mine just had a new baby and for the first night home their 3yo stayed with his grandparents. It sounds kind of nice but I am worried I would miss my LO too much?!