Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller
cs.CR, cs.AI, cs.CL
Submitted: 2026-10-08
Updated: 2026-10-08
Comments: 31 pages, 5 figures, 13 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Backdoor Attacks on Large Language Models (LLMs) typically follow a trigger-response pattern, where satisfying a trigger condition activates a single terminal behavior.
Abstract
Backdoor Attacks on Large Language Models (LLMs) typically follow a trigger-response pattern, where satisfying a trigger condition activates a single terminal behavior. However, this single-point backdoor activation does not explore attacks in which malicious behavior develops gradually through multiple intermediate stages before reaching the terminal activation stage. We present Cancerous Backdoor Attack, that gradually corrupts an LLM's reasoning over a sequence of interactions by leveraging invisible tokens and a stage controller. Specifically, invisible tokens provide hidden stages to the model without appearing in the user's visible request and the stage controller tracks the attack's progression during inference to realize gradual activation. We evaluate Cancerous Backdoor Attack across several reasoning datasets. The attack consistently produces gradual reasoning corruption across models and tasks. We compare Cancerous Backdoor Attack with prior backdoor attack baselines to demonstrate our proposed attack outperforms the baselines. Our results indicate that reasoning corruption can develop gradually before it becomes visible, making answer accuracy alone insufficient for detecting backdoor attacks.
Sources
- Thought-Transfer: Indirect Targeted Poisoning Attacks on Chain-of-Thought Reasoning Models
- Training Verifiers to Solve Math Word Problems
- QLoRA: Efficient Finetuning of Quantized LLMs
- Delayed Backdoor Attacks: Exploring the Temporal Dimension as a New Attack Surface in Pre-Trained Models
- Reasoning Introduces New Poisoning Attacks Yet Makes Them More Complicated
- DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs
- LoRA: Low-Rank Adaptation of Large Language Models
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
- Mistral 7B
- BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models
- Virus Infection Attack on LLMs: Your Poisoning Can Spread "VIA" Synthetic Data
- Sleeper Cell: Injecting Latent Malice Temporal Backdoors into Tool-Using LLMs
- Qwen2.5 Technical Report
- Stateless Yet Not Forgetful: Implicit Memory as a Hidden Channel in LLMs
- Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought
- DecepChain: Inducing Deceptive Reasoning in Large Language Models
- Large Language Models Encode Clinical Knowledge
- Multi-Trigger Poisoning Amplifies Backdoor Vulnerabilities in LLMs
- BloombergGPT: A Large Language Model for Finance
- BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs