Answer is: convicted prisoners.
The British colony of New South Wales (Australia) was established with the arrival of the fleet (11 ships) in 1788. From 1788 until 1823, the Colony of New South Wales was a penal colony, inhabited mainly with convicts.
