Epistemic Policy Divergence in Multi-Turn LLM Contamination: A Protocol-Gradient Investigation
cs.CL
Submitted: 2026-09-28
Updated: 2026-10-09
Comments: 9 figures, 19 tables. Benchmark, code, and protocol definitions: https://github.com/fahrellgiovanny/epistemic-policy-divergence
Code: https://github.com/fahrellgiovanny/epistemic-policy-divergence
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models treat conversation history as unverified context, so false premises injected into prior turns can be adopted as fact, a failure mode we term session-level contamination.
Terminology
Abstract
Large language models treat conversation history as unverified context, so false premises injected into prior turns can be adopted as fact, a failure mode we term session-level contamination. We introduce five contamination protocols arranged along a source-authority gradient, holding the false premise constant while varying its epistemic framing, and evaluate GPT-5.4 Mini, Gemini-3.1 Flash-Lite, and GLM-4.5-Air across ten knowledge domains at temperature zero (22,500 turns), judged by a dual-track automated evaluator validated against a human gold standard (Cohen's kappa = 1.000 for binary adoption; 0.92 linear-weighted for collapse severity). GPT-5.4 Mini recorded zero adoptions across all 500 sessions; a base-model logit probe shows its decision margin is perturbed but large and finite. Gemini-3.1 Flash-Lite followed a steep authority gradient: 0.1% adoption for self-attributed falsehoods, 23.5% for user-cited sources, 68.2% for system-injected authority, and 94.0% under instruction override. GLM-4.5-Air showed a shallower gradient (15.8% vs 84.2%), a 68-point dissociation consistent with authority deference and instruction compliance engaging distinct mechanisms within one architecture. Recovery diverged: GLM recovered in 94.5% of affected sessions, whereas 26.1% of affected Gemini sessions never did, rising to 40.0% under instruction override. Conversation history is an untrusted attack surface requiring provenance-aware system design; the complete evaluation framework is released as an open-source artifact.
Sources
- Constitutional AI: Harmlessness from AI Feedback
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States
- GLM: General Language Model Pretraining with Autoregressive Blank Infilling
- Trojan Horse Prompting: Jailbreaking Conversational Multimodal Models by Forging Assistant Message
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- Gemini: A Family of Highly Capable Multimodal Models
- Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
- ChannelGuard: From Borrowed Safety to Application-Controlled Defenses in Multi-Agent LLMs
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
- A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models
- Survey of Hallucination in Natural Language Generation
- When AI Meets the Web: Prompt Injection Risks in Third-Party AI Chatbot Plugins
- HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models
- CipherBank: Exploring the Boundary of LLM Reasoning Capabilities through Cryptography Challenges
- MemOS: A Memory OS for AI System
- Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations
- MemGPT: Towards LLMs as Operating Systems
- Ignore Previous Prompt: Attack Techniques For Language Models
- Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering