Read Once, Answer Many: Parallel Prompting for Shared-Context LLM Inference
cs.CL, cs.AI, cs.DC, cs.LG
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/jlab-nlp/parallel-prompting
Project page: https://jlab-nlp.github.io/parallel-prompting
Terminology
Sources
- Accelerating Large Language Model Decoding with Speculative Sampling
- The Llama 3 Herd of Models
- Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
- Hydragen: High-Throughput LLM Inference with Shared Prefixes
- Qwen2.5 Technical Report
- BloombergGPT: A Large Language Model for Finance
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data