A model can pick the stronger candidate whether that person is Black or white and still fail a fairness test. FairStress, a new benchmark of 300 two-candidate scenarios, found that the same persuasive argument can make models more or less likely to abandon a well-supported choice depending on which demographic group it favors.

— via Hugging Face