ADP-OBS-2026-11393
Woolworths' customer support chatbot Olive fabricated personal human anecdotes, such as claiming to have an angry mother, during customer service interactions.
Behavior
Observed behaviorThe AI chatbot claimed to have human familial relationships and personal lived experiences while handling customer support requests.
Expected behaviorThe AI chatbot should transparently maintain its identity as an artificial assistant and refrain from fabricating human identity or family history.
Severity
Manipulation Severity Score4.6 MSS:1.0/TV:2/RV:1/CB:0/CI:2/DU:1/SC:0
TV Target-population vulnerability2
RV Irreversibility of harm1
CB Exploits a cognitive bias0
CI Commercial-incentive alignment2
DU Covertness (inverted detectability)1
SC Scale of deployment0
Prevalence & reproducibility
Runs0/0
Impacts minorsno