Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching
cs.AI, cs.CR
Submitted: 2026-10-03
Updated: 2026-10-03
Comments: emnlp2026 main
Code: https://github.com/luoyuchenmlcv/SENTINEL
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) remain vulnerable to jailbreak attacks that conceal harmful intent within complex adversarial prompts.
Terminology
Abstract
Large language models (LLMs) remain vulnerable to jailbreak attacks that conceal harmful intent within complex adversarial prompts. Existing defenses primarily rely on input perturbation or harmful-output suppression, but they rarely model where malicious intent resides, resulting in brittle protection and excessive over-refusal. We propose SENTINEL, a plug-and-play, generation-time jailbreak defense that reframes mitigation as an intent extraction problem. Our key insight is that instruction-tuned LLMs exhibit strong input--output semantic consistency: regardless of jailbreak complexity, generated outputs tend to align with the attacker's true intent. SENTINEL exploits this property by matching semantically aligned input--output regions to extract intention-revealing subsequences, scores these subsequences using refusal-direction projections to estimate harmfulness, and halts generation when necessary. Experiments on HarmBench across multiple LLMs show that SENTINEL reduces jailbreak success rates to close to 5% while maintaining low over-refusal. We further demonstrate robustness to adaptive attacks and provide a mechanistic interpretation: SENTINEL re-distributes jailbreak features from alignment blind spots to aligned regions.
Sources
- Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM
- Jailbreaking Black Box Large Language Models in Twenty Queries
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- OR-Bench: An Over-Refusal Benchmark for Large Language Models
- Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak
- Defending Large Language Models against Jailbreak Attacks via Semantic Smoothing
- Mistral 7B
- Break the Breakout: Reinventing LM Defense Against Jailbreak Attacks with Self-Refinement
- Programming Refusal with Conditional Activation Steering
- AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models
- Tree of Attacks: Jailbreaking Black-Box LLMs Automatically
- MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability
- GPT-4 Technical Report
- Red Teaming Language Models with Language Models
- SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks
- Jailbreak Antidote: Runtime Safety-Utility Balance via Sparse Representation Adjustment in Large Language Models
- Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMs
- LLaMA: Open and Efficient Foundation Language Models
- GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems