Cheap to Draw, Expensive to Trust: Certifying Test-Time Scaling Curves
The paper develops a cost law to certify scaling curves for AI test-time sampling methods. It shows that simple methods are cheap to draw but often lead to incorrect uncertainty estimates. The certified cost involves calibrating the score tail, identifying questions, and accounting for within-question noise.