Information-Theoretic Foundations of Online Temperature Sampling
LLM repetition is a failure of standard sampling methods like temperature scaling. The offline solution is fixed temperature sampling, but for online generation where text is revealed sequentially, a dynamic approach is needed. Entropic Online Sampling (EOS) re-solves the optimal temperature for every prefix to maximize diversity under a global budget.