Two Calls, Two Moments, and the Vote-Accuracy Curve of Repeated LLM Inference
The study uses two labeled calls to identify key moments of a latent success probability distribution from repeated LLM inferences. This allows for sharp, distribution-free intervals that separate stable errors from random call-level noise. It shows how majority voting can reduce many calls to a fixed budget while providing strong certification.