Do you do whites, colors, and another special load (like towels/bedding)? Do you break it down even further?

I'm terrible about sorting laundry and usually the only things I make an effort to separate are towels and bedding (terrible, I know!). I really dislike using the machine for a small load of whites or delicates. I used to keep baby/toddler clothes separate from ours, but now I do them all together. I've noticed that our stuff is getting dingy quicker than it used to so I really want to get better at sorting!