But in all that time has there really never been a black pope? ... According to the sixth-century Liber Pontificalis, the earliest known record of the popes, Victor was from North Africa, while Miltiades and Gelasius likely were born in Rome to families of African origin.