The State-Prediction Separation Hypothesis
cs.CL, cs.AI, cs.LG
Submitted: 2026-07-01
Updated: 2026-11-05
Code: https://github.com/lil-lab/sps
Terminology
Sources
- Efficient Joint Prediction of Multiple Future Tokens
- Neural Machine Translation by Jointly Learning to Align and Translate
- Accelerating Large Language Model Decoding with Speculative Sampling
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- DeepSeek-V3 Technical Report
- The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- PaSS: Parallel Speculative Sampling
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data