Andrew Edwards was the voice heard saying white men should have black slaves, investigation finds.