The most accurate inference would be:
Those states used slave labor to grow different crops.
This suggests that the increase in enslaved workers is not necessarily tied to cotton production, but rather to other agricultural activities or crops that could have required slave labor.