The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management
cs.CL
Submitted: 2026-05-21
Updated: 2026-06-27
Terminology
Sources
- Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models
- MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents
- Holistic Evaluation of Language Models
- Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
- Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarios
- Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
- Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
- Let's (not) just put things in Context: Test-Time Training for Long-Context LLMs
- Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalization
- LongBench Pro: A More Realistic and Comprehensive Bilingual Long-Context Evaluation Benchmark
- In-context Autoencoder for Context Compression in a Large Language Model
- Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning
- Resilient Routing: Risk-Aware Dynamic Routing in Smart Logistics via Spatiotemporal Graph Learning
- Sustainable Hybrid Document-Routed Retrieval for Financial RAG: Resolving the Robustness-Precision Trade-off
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data