Settlers knew the slaves would be set free one day
The economy of many colonies depended on slavery
The settlers did not know how to grow crops themselves
Slavery was still legal in Europe and other parts of the world
Without the slaves the economy could not have grown so big. If families did not receive food because there wasn't enough of it harvested, then the economy would have gone down.