Would you ever consider purchasing a bag you really just love, and then also purchasing and adding in a Diaper Bag Organizer Insert?

Has anyone done this? Thoughts?

I am having such a hard time finding a bag that I can afford that also gives me most of my other "must haves."