We go all the time to visit family or friends. We live so far away from so many people! We were gone every weekend in March except one, and one weekend in February. We'll be gone three weekends in May (one weekend is just a day trip, but it is to a wedding three hours away).
I think it is so important to get out with a baby. Every time I go away, my confidence increases. But it does mean that a lot of home repair things go unattended.
Oddly enough I think the reason why we are so confident as travelers is because baby had some faux health problems when he was a newborn and we had to travel to a hospital about 2 hrs. away and would stay overnight with family to make the trip less exhausting. It made us much more comfortable with traveling very quickly.