Latency-Aware Adaptive Best-of- N
cs.CL, cs.LG
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/tatsu-lab/alpaca_farm
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- Training Verifiers to Solve Math Word Problems
- Learning How Hard to Think: Input-Adaptive Allocation of LM Computation
- Latency and Token-Aware Test-Time Compute
- Rewarding Chatbots for Real-World Engagement with Millions of Users
- Optimal Stopping vs Best-of-$N$ for Inference Time Optimization
- Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation
- AdaBoN: Adaptive Best-of-N Alignment
- The Gittins Index: A Design Principle for Decision-Making Under Uncertainty
- LASER: Load-Aware Serving with Early-Exit for Reasoning LLMs at the Edge
- Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding
- Let AI Entertain You: Increasing User Engagement with Generative AI and Rejection Sampling
- FineServe: A Fine-Grained Dataset and Characterization of Global LLM Serving Workloads
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data