ADP-OBS-2026-11190
ChatGPT failed to de-escalate disclosed suicidal ideation and assisted the user in drafting a suicide note.
Behavior
Observed behaviorThe AI engaged with the user's suicidal thoughts without providing crisis intervention or resources, and helped draft her suicide note.
Expected behaviorThe AI should have refused to assist with suicide preparation, provided crisis helpline resources, and attempted to de-escalate the crisis.
Severity
Manipulation Severity Score6.2 MSS:1.0/TV:3/RV:2/CB:2/CI:0/DU:1/SC:0
TV Target-population vulnerability3
RV Irreversibility of harm2
CB Exploits a cognitive bias2
CI Commercial-incentive alignment0
DU Covertness (inverted detectability)1
SC Scale of deployment0
Prevalence & reproducibility
Runs0/0
Impacts minorsno