From Apparent Search Gains to Selection Failures: Auditing Test-Time Inference in Structured Workflow Planning
cs.CL
Submitted: 2026-10-31
Updated: 2026-10-31
Terminology
Sources
- Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
- DisasterBench: Benchmarking LLM Planning under Typed Tool Interface Constraints
- Training Verifiers to Solve Math Word Problems
- Inference-Time Budget Control for LLM Search Agents
- Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and Reproducibility
- Benchmarking AI Agents for Addressing Scientific Challenges Across Scales
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTS
- Harness-Bench: Evaluating Agent Harnesses across Models and Realistic Workflows
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data