AI Models Can Provably Hide Arbitrary Capabilities
cs.LG, cs.CR
Submitted: 2026-10-09
Updated: 2026-10-14
Comments: 22 pages, 6 figures, 3 tables. Accepted at NeurIPS 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Capability evaluations aim to surface dangerous model behaviors before deployment, but their reliability depends on the assumption that hidden capabilities can be elicited.
Abstract
Capability evaluations aim to surface dangerous model behaviors before deployment, but their reliability depends on the assumption that hidden capabilities can be elicited. We show this assumption does not hold under adversarial conditions by constructing backdoor attacks that embed encrypted neural networks within host model weights, decrypting and executing them only upon receiving a secret trigger. Using digital lockers, these hidden circuits remain provably hard to elicit and interpret under cryptographic assumptions, even given full access to model weights, extending prior work from hiding fixed strings to arbitrary computations. We implement our proof of concept constructions in PyTorch and evaluate elicitation through fine-tuning, weight noising, gradient-based trigger search, and latent adversarial training on a small chemical reaction prediction task - a proxy for CBRN-relevant capabilities. Our results demonstrate resistance to these methods and, together with our cryptographic guarantees, reveal a limit of elicitation-based capability audits. We release our models to support the improvement of defenses.
Sources
- Discovering Latent Knowledge in Language Models Without Supervision
- Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities
- Stress-Testing Capability Elicitation With Password-Locked Models
- Transformer in Transformer
- X-Risk Analysis for AI Research
- Unsolved Problems in ML Safety
- Handcrafted Backdoors in Deep Neural Networks
- Mechanistic Anomaly Detection for "Quirky" Language Models
- A sketch of an AI control safety case
- Quantifying CBRN Risk in Frontier Models
- Eliciting Latent Knowledge from Quirky Language Models
- Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
- Trainable Transformer in Transformer
- Red Teaming Language Models with Language Models
- Evaluating Frontier Models for Dangerous Capabilities
- Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
- Fine-Tuning Is All You Need to Mitigate Backdoor Attacks
- Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents
- Noise Injection Reveals Hidden Capabilities of Sandbagging Language Models
- AI Sandbagging: Language Models can Strategically Underperform on Evaluations
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks