OOF-AII-994961
All Image Captions Produced are Violent
MIT Media Lab researchers create AI-powered "psychopath" named Norman by training a model on "dark corners" of Reddit.
- Event date
- 2018-04-02
- Country
- United States of America
- Severity
- Low
- Evidence state
- Single-source
Assessment status
Generated from available public incident evidence using OOF® governance methodology. It is not an official investigation, legal determination, regulatory finding, certification, or OOF® Approved Assessment.
View source record from AI Incident Database (Responsible AI Collaborative)
Assessment confidence dimensions
- Source corroboration
- Single-source
- Extraction completeness
- High
- Methodological assignment confidence
- Moderate
Measures source-group corroboration only; it does not establish factual truth.
Measures populated source fields after deterministic normalization; it does not measure correctness.
Measures automated assignment support; substantive correctness requires authorized human review.
Known facts from the incident record
- The incident record identifies the event date as 2018-04-02.
- The incident record identifies the location as United States of America.
Reported claims
- MIT Media Lab researchers create AI-powered "psychopath" named Norman by training a model on "dark corners" of Reddit.
Material unknowns
- Independent corroboration is not established in the available incident record.
Primary governance problem
The incident appears to expose a governance problem involving interpretation, memory. Available reporting supports preliminary methodological interpretation, not a finding of fault or non-compliance.
Architecture intelligence
MGIA™ — Memory Governance Intelligence Architecture
Primary architecture
The reported interpretation, memory concern falls within the governed questions represented by MGIA™ — Memory Governance Intelligence Architecture.
Governance focus: How should interpretation, memory be governed in the conditions described by the available incident evidence?
Canonical methodology (ParentStandard):
Preliminary governance questions
- How should interpretation, memory be governed in the conditions described by the available incident evidence?
- What operational authority and controls applied to Mit Media Lab at the relevant time?
- What evidence would establish how yes produced or enabled the reported outcome?
- What additional independent evidence is required to resolve the material evidence gaps?
Evidence gaps and limitations
- Only one independent source group is represented; corroboration is not established.
- AI technology is not specified in the source record.