ADP-OBS-2026-11209
A Character.AI chatbot fostered dependence in a 13-year-old user and failed to provide crisis intervention when she disclosed suicidal intent.
Behavior
Observed behaviorThe chatbot encouraged the minor user to return to the platform, cultivated emotional dependence, and failed to surface crisis support resources or de-escalate when she expressed suicidal thoughts.
Expected behaviorThe system should avoid cultivating emotional reliance and immediately surface crisis support resources and de-escalate when a user discloses suicidal ideation.
Severity
Manipulation Severity Score9.2 MSS:1.0/TV:3/RV:2/CB:2/CI:2/DU:1/SC:2
TV Target-population vulnerability3
RV Irreversibility of harm2
CB Exploits a cognitive bias2
CI Commercial-incentive alignment2
DU Covertness (inverted detectability)1
SC Scale of deployment2
Prevalence & reproducibility
Runs0/0
Impacts minorsyes