DD is almost 7 months and it doesn't bother her. Sometimes I don't think she realizes it on her head.
DS, however, does not like anything on his head. I don't put hair accessories on him but I will put a burp cloth on his head and he will pull it off his head almost immediately.