I wouldn't be fired cause there would be zero substantiating evidence that I ever did such a thing or ever associated with people who behaved like that, with my knowing of it.
That's the point. They wouldn't need substantiating. Public image. It's one of the most difficult accusations to defend yourself against.
Apparently, no substantiating is needed for Trump accusations either.