Capability-Gated Language Models: Security Composes, Utility Does Not
cs.CR, cs.AI, cs.LG
Submitted: 2026-08-31
Updated: 2026-10-16
Comments: Accepted to NeurIPS 2026 Workshop on Foundations of Language Model Security
License: http://creativecommons.org/licenses/by/4.0/
The gist: Deployed language model safeguards (safety fine-tuning, filtering, unlearning) vary by principal only outside the model weights: filters are reconfigured, tiers are multiplied, and artefacts are
Terminology
Abstract
Deployed language model safeguards (safety fine-tuning, filtering, unlearning) vary by principal only outside the model weights: filters are reconfigured, tiers are multiplied, and artefacts are reissued; inside one set of weights every request meets the same model configuration. This motivates us to define capability-gated deployment: per-principal access control inside one set of weights, whose configurations form a lattice - meets accumulate a principal's restrictions and joins pool a coalition's reach. We instantiate it by sparse rank gating over an existing nested-factorisation mechanism, guide profile search with one-pass attribution, and read every result once from a pre-registered held-out split. Security approximately composes: provably exactly at meets under a monotone-elicitation assumption we falsify pointwise. In two lineages the median held-out meet deepens suppression; the one effect surviving correction strengthens it. Utility does not: individually harmless profiles can compose to retention and fluency damage, and no compositional bound exists.
Sources
- SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
- Constitutional AI: Harmlessness from AI Feedback
- Do Unlearning Methods Remove Information from Language Model Weights?
- The MiniPile Challenge for Data-Efficient Language Models
- Evaluating Frontier Models for Dangerous Capabilities
- Qwen3 Technical Report
- Modular Pretraining Enables Access Control
- Model evaluation for extreme risks
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs