I forgot to bring an ice pack to work. I can keep the milk in the fridge at work all afternoon (I have the cooler case that comes with the medela freestyle kit), but for the actual drive home will it be ok to be out the fridge for about 40 minutes and then put it back in the fridge again once i am home? or should i leave it at work until i bring an ice pack tomorrow?