It would seem to me that racism is an integral part of a truly free society... and any successful attempt to stop racism would result in a society that was less than "truly free"... So do you want a truly free society or an almost free society?
In what way are slaves truly free?