External Experience Serving in Production LLM Systems: A Deployment-Oriented Study of Quality-Cost Trade-offs
cs.CL
Submitted: 2026-06-10
Updated: 2026-11-02
Terminology
Sources
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- Improving language models by retrieving from trillions of tokens
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Efficient Memory Management for Large Language Model Serving with PagedAttention
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- REPLUG: Retrieval-Augmented Black-Box Language Models
- BEAR: Budgeted Evidence Allocation for Multi-Document Reasoning
- Qwen3 Technical Report
- ReAct: Synergizing Reasoning and Acting in Language Models
- Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
- Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data