“All men not born in the Island were to be taken away”