Ensembling Language Models with Sequential Monte Carlo
cs.CL, cs.AI, cs.LG
Submitted: 2026-03-05
Updated: 2026-11-07
Code: https://github.com/chanr0/smc_ensembling
Terminology
Sources
- Phi-4 Technical Report
- Harnessing Multiple Large Language Models: A Survey on LLM Ensemble
- JSONSchemaBench: A Rigorous Benchmark of Structured Outputs for Language Models
- Collaborative decoding of critical tokens for boosting factuality of large language models
- Purifying Large Language Models by Ensembling a Small Language Model
- Cool-Fusion: Fuse Large Language Models without Training
- The Llama 3 Herd of Models
- Qwen2.5 Technical Report
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data