Amazon already made a racist hiring AI that immediately disqualified anyone with a black sounding name, so it's a bit late.

From what I understood, the AI used hiring information to identify ideal candidates. So, it would look for traits that are common in resumes and applications that are accepted and hired. The issue, however, was that the majority of people that apply are white men. That necessarily means that more white males are hired than other groups. So, the AI associated the characteristics shared most commonly between white applicants as the best hires.

This created a feedback loop which resulted in it hiring only people with characteristics ascribed to white people, and especially white men.