I have a backpack style carrier that can be worn on the front or back. I've always used it on my front with the baby facing me. When do I switch him to face out?