The best explanation for the size difference between New England farms and southern farms during colonial times is:
In New England, the soil was poor and the growing season was short, so the farms were smaller.
New England's rocky soil and harsh climate limited large-scale agricultural production, which contrasted with the southern colonies, where fertile soil and a longer growing season allowed for larger plantations and farms.