Well, I know for a fact that African slaves were a large work force on any plantation. If I had to say one of these answers, though, I would say European Settlers, as they would have run the plantation before they could acquire slaves.
hope this helps