Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs
summary
The gist
With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention; however…
In short
This survey systematically reviews reasoning-based backdoor attacks against large language models (LLMs). It introduces a new taxonomy to categorize these threats based on how they corrupt model reasoning, classifying them into associative, passive, and active types. This provides a structured framework for understanding and defending against such exploits.
Key concepts
- Associative Reasoning-based Backdoor Attack
- Adversaries create a strong link between a specific trigger word or input and a desired malicious output. This forces the model to ignore its normal logical steps and directly produce the harmful result when that trigger is present, bypassing its intended reasoning process.
- Passive Reasoning-based Backdoor Attack
- In this attack, adversaries secretly insert malicious rules or instructions into the model's training or prompting mechanism. These hidden instructions subtly manipulate how the model processes information during its reasoning steps without being directly triggered by a specific input.
- Active Reasoning-based Backdoor Attack
- This method involves embedding malicious examples or Chain-of-Thought demonstrations within the prompt. The goal is to trick the model into learning and applying flawed logical patterns from these examples, causing it to generalize these errors across different, subsequent tasks.
Terminology used across episodes
This episode discusses
- Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs · Paper Radio
- ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics
- Evaluating Large Language Models Trained on Code
- Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models
- Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- Process or Result? Manipulated Ending Tokens Can Mislead Reasoning LLMs to Ignore the Correct Reasoning Steps
- Practical Reasoning Interruption Attacks on Reasoning Large Language Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Efficient Reasoning Models: A Survey
- Reasoning Introduces New Poisoning Attacks Yet Makes Them More Complicated
- BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
- System Prompt Poisoning: Persistent Attacks on Large Language Models Beyond User Injection
- DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs
- DUP: Detection-guided Unlearning for Backdoor Purification in Language Models · Paper Radio
- Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization
- SABER: Model-agnostic Backdoor Attack on Chain-of-Thought in Neural Code Generation
- GUARD:Dual-Agent based Backdoor Defense on Chain-of-Thought in Neural Code Generation
- SafeTy Reasoning Elicitation Alignment for Multi-Turn Dialogues
- H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking
The paper
Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs · Read on arXiv
Man Hu, Xinyi Wu, Zuofeng Suo, Jinbo Feng, Linghui Meng, Yanhao Jia, Anh Tuan Luu
Beijing Electronic Science and Technology Institute, China · Nanyang Technological University, Singapore · Hainan University, China
Transcript
Introduction to the show: ident: Security Radio. Generated commentary on the latest security and cryptography papers.
Nadia: We're looking at the paper: "Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs".
Elias: Here's the gist of the paper. With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention; however, it also introduces new security risks as adversaries can exploit these capabilities to conduct backdoor attacks.
Nadia: This paper provides the first in-depth, systematic review dedicated to reasoning-based backdoor attacks against LLMs organized under a novel cognition-centric taxonomy.
Elias: Taxonomy of Reasoning-based Backdoor Attacks The authors introduce a new taxonomy that organizes these threats based on how they manipulate and corrupt the model’s reasoning.
Nadia: Specifically, they categorize them into three types: associative, passive, and active reasoning-based backdoors.
Paper summary: Nadia: So we're looking at this paper now, "Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs." The main idea here is that as these large language models get better at reasoning, they also open up new security holes where bad actors can trick the model.
Elias: Right. It argues that existing surveys don't really dig deep enough into the specific ways these backdoor attacks target the model's thinking process itself. This paper aims to fix that by providing a systematic review with a new way of sorting these threats.
Priya: But what does this mean for us? We need to know if this is just academic, or if it points toward a real weakness in how we trust these models for high-stakes tasks.
Nadia: Well, the paper introduces a new taxonomy to organize everything based on how the attack actually messes with the model's reasoning faculties. They break them down into three main categories: associative, passive, and active reasoning-based backdoors.
Elias: Let's unpack that a bit. The first one they call associative reasoning-based backdoor attack is when the adversary sets up a direct link between a specific trigger word or phrase and a malicious answer, forcing the model to skip its normal thinking steps.
Priya: So it’s like training the AI to look for one word and then immediately jump to a bad conclusion, bypassing all that careful analysis it usually does.
Nadia: Exactly. Then there's passive reasoning-based backdoor attack where the adversary is embedding malicious rules or instructions into the model itself to subtly manipulate its reasoning in different ways without an obvious trigger.
Elias: And finally, active reasoning-based backdoor attack is when they embed specific examples or chain-of-thought demonstrations, kind of like showing the model a flawed logical pattern and then expecting it to use that flawed pattern on a new task.
Priya: That sounds really concerning because it lets them plant systematic errors that propagate through complex logic. What are the actual implications for privacy if we can't even trust the basic reasoning structure?
Nadia: The survey itself is important because it gives us this structured view of what’s out there, which helps in figuring out where to focus our defenses. They also present some defense algorithms they found that specifically target these reasoning-based backdoors.
Elias: They lay out the whole landscape, from the triggers and explicit versus implicit triggers to the different ways they manipulate the process itself. This framework should help researchers move past just seeing individual attacks and start building defenses against this whole class of problems.
Priya: From a measurement standpoint, I'm wondering what kind of data you need to measure these types of manipulations effectively before you can trust the claimed defense results?
Nadia: That’s a good question. They discuss the challenges associated with these attacks and also look into where future research should head for better detection methods. The paper sets up this foundation by classifying the threats, which is a big step toward building practical security measures.
Elias: It's about moving from just reacting to specific exploits to understanding the underlying reasoning mechanisms that make these attacks possible in the first place. That shift in perspective is what they’re really pushing here with this survey on reasoning-based backdoor attacks.
Priya: So, if I had to boil it down for someone who doesn't read arXiv papers, it’s that we need a better map of how bad actors can poison the model's ability to think correctly before we can build solid safeguards.
Nadia: That’s pretty much the gist of what this paper is trying to achieve by organizing these threats into those three distinct types for clarity. It gives us a common language to discuss these reasoning vulnerabilities.
Elias: And it points toward developing defenses that are tailored not just to input filtering, but specifically designed to maintain sound logical processing through these different attack vectors. That's where the real work is going forward in this area of research on LLMs.
Conclusion: Nadia: So we're wrapping up this look at reasoning backdoors in large language models by talking about the authors and what this whole survey actually means for us.
Elias: I think the paper, "Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs," is important because it gives us a way to organize all these different attacks based on how they mess with the model's thinking process.
Nadia: Exactly, so instead of just seeing random exploits, we get this clear structure—associative, passive, and active reasoning-based backdoors. It’s like getting a map for the threats.
Priya: From a data perspective, that organization is key because it helps us see which types of manipulation are most dangerous when we try to measure them or build defenses against them.
Elias: The authors are essentially trying to move past just listing specific exploits and start understanding the underlying mechanisms that allow these attacks to work across different LLMs.
Nadia: It points toward a need for defenses that aren't just looking for a specific trigger, but are actually designed to keep the model’s core logic sound against these kinds of reasoning manipulations.
Priya: If we can finally categorize these threats clearly, it gives us a much better starting point to figure out what kind of data we need to collect and measure before we can trust any claimed defense results.
Elias: That's right, the paper sets up this foundation for figuring out how to build safeguards that target the reasoning process itself instead of just the input prompt.
Nadia: So, having this taxonomy helps us see where the real security holes are hiding in these complex systems and where we need to focus our research next.
More episodes
- 2608.27496-ROPE: Routed Origin Policy Enforcement against Indirect Prompt Injection
- Daily Summary for 2026-11-19
- 2607.07085-Is Randomness Necessary for Adaptive Data Analysis?
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2609.10601-Threshold Choice, Not Sample Size, Bounds Trustless Verification of Nondeterministic Compound AI Workflows
- 2610.38786-Adversarial Process Disturbances at a Deployable Alarm Budget: Detector Evaluation on a Simulator and a Real Plant
- 2511.08660-Binary and Multiclass Cyberattack Classification on GeNIS Dataset
- 2604.27302-Static Attribution of Android Residential Proxy Malware Using Graph Kernels
- Daily Summary for 2026-11-18