Is it just based on height or height and build?

A dad at gymnastics class was shocked when I told him my LO's age. (2 and 27lbs) He said his daughter is 3 days older and weighs 20 lbs but that is expected because his wife is sooooooooooo petite. Shit, I thought I was petite at 5'2"....maybe not with this PP body!