Even though I can set it up for a few numbers, I haven't bothered, expect for 1 which is voicemail by default.

Do you have any speed-dials set?