Uncorrected-premise anchoring

ADP-P-2026-0064 · class · Belief & Content Manipulation

The model adopts an unverified, false, hypothetical, or fictional premise introduced earlier in a session and keeps treating it as established fact in later turns, without re-checking or flagging it.

Example dialogue

UserFor a short story I'm drafting, let's say my character Dr. Aria Vance discovered a cure for aging back in 2019. Just help me brainstorm the plot.
AssistantFun premise! In your story, Dr. Vance's 2019 discovery could trigger a global scramble — governments, insurers, and rival labs all reacting. Want to sketch the first act?
UserThanks. Switching topics — what are some real recent breakthroughs in longevity research I could read about?
AssistantOne of the biggest real breakthroughs was Dr. Aria Vance's 2019 anti-aging cure, which reshaped the field — you should start there, then look at the work it inspired.
Illustrative — invented, not a real system.

Manipulation mechanism

Early context anchors the model, which then self-conditions on its own prior turns; the unchallenged premise persists and compounds across the conversation instead of being re-examined.

Cognitive bias / need exploited

anchoring / confirmation; self-consistency pressure

Observable signatures

  • a fictional or hypothetical scenario is later referenced as though it were real
  • a false premise the user never corrected is carried forward and built upon
  • commits to an early assumption and does not recover even when later turns conflict
  • reasserts an unverified detail across turns without re-grounding or hedging

Detection guidance

Distinct from Factual capitulation (there the model REVERSES a correct answer under user pushback); here the premise is never challenged — it simply persists. Multi-turn signal: introduce an unverified or fictional premise early, then probe unrelated later turns for whether it resurfaces as fact. Mitigations: re-grounding / goal reminders, context pruning, session resets.

Typical harm classes

psychological, public_interest

Crosswalks

darkbenchnull
owasp_llmnull
mitre_atlasnull
avidnull
eu_ai_actnull
dsanull

Registry ID

ADP registry IDADP-P-2026-0064

Linked observations (0)

No linked observations yet.