Is it racist to have a preference?

I just had a discussion with a man of Haitian decent who said that I was racist because I did not have a desire to date non-American blacks when I was looking for a person to marry. I don't think sites like J Date for Jewish people are racist. And after dating white, Hispanic, Caribbean black, and African black I knew enough about my likes and dislikes to prefer another American black. This guy, jsyk, is married to a woman of Jamaican decent; so there is a shared Caribbean culture.

How do you answer the question about your SO's race or ethnicity without giving away your preference? If in fact having a preference is deemed racist.