OOF-AII-967001
Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
- Event date
- 2016-08-10
- Country
- Ireland
- Severity
- Low
- Evidence state
- Single-source
Assessment status
Generated from available public incident evidence using OOF® governance methodology. It is not an official investigation, legal determination, regulatory finding, certification, or OOF® Approved Assessment.
View source record from AI Incident Database (Responsible AI Collaborative)
Assessment confidence dimensions
- Source corroboration
- Single-source
- Extraction completeness
- High
- Methodological assignment confidence
- Moderate
Measures source-group corroboration only; it does not establish factual truth.
Measures populated source fields after deterministic normalization; it does not measure correctness.
Measures automated assignment support; substantive correctness requires authorized human review.
Known facts from the incident record
- The incident record identifies the event date as 2016-08-10.
- The incident record identifies the location as Ireland.
Reported claims
- Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
Material unknowns
- Independent corroboration is not established in the available incident record.
Primary governance problem
The incident appears to expose a governance problem involving support, associated, models, relied. Available reporting supports preliminary methodological interpretation, not a finding of fault or non-compliance.
Architecture intelligence
PGA™ — Prediction Governance Architecture
Primary architecture
The reported support, associated, models concern falls within the governed questions represented by PGA™ — Prediction Governance Architecture.
Governance focus: How may a prediction be communicated, interpreted, and relied upon without exceeding what its methodology, uncertainty, feasibility, intended purpose, and governed conditions legitimately support?
Canonical methodology (ParentStandard):
Preliminary governance questions
- How may a prediction be communicated, interpreted, and relied upon without exceeding what its methodology, uncertainty, feasibility, intended purpose, and governed conditions legitimately support?
- What operational authority and controls applied to Amazon at the relevant time?
- What evidence would establish how Enterprise Ai Systems, Associated Machine Learning Models Trained On Historical Amazon Resume Data, Amazon Experimental Ai Resume Scoring Engine, Ai Enabled Decision Support Systems produced or enabled the reported outcome?
- What additional independent evidence is required to resolve the material evidence gaps?
Evidence gaps and limitations
- Only one independent source group is represented; corroboration is not established.
- AI technology is not specified in the source record.