CoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing
The episode discusses CoBa, a method for cost-effective test-time scaling that treats sampling, verification, and stopping as competing actions under a fixed inference budget. Hosts highlight its routing policy, parameter-weighted cost metric, and results showing accuracy matching baselines with up to 58.9% fewer tokens.