Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoning
Power-SMC is a training-free method that approximates sequence-level power sampling by using parallel candidate continuations and sequential Monte Carlo techniques. It sharpens generation toward high-likelihood sequences without modifying model weights, significantly reducing inference latency compared to older methods like Metropolis–Hastings.