Rethinking AI Cloud Infrastructure for Agentic Serving Systems with the Aries Experimentation Framework
cs.DC
Submitted: 2026-07-31
Updated: 2026-11-03
Code: https://github.com/hyscale-lab/aries
Terminology
Sources
- Kairos: Low-latency Multi-Agent Serving with Shared LLMs and Excessive Loads in the Public Cloud
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
- Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
- ACON: Optimizing Context Compression for Long-horizon LLM Agents
- SideQuest: Model-Driven KV Cache Management for Long-Horizon Agentic Reasoning
- Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
- LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference
- Large Language Model Agent: A Survey on Methodology, Applications and Challenges
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows
- KVFlow: Efficient Prefix Caching for Accelerating LLM-Based Multi-Agent Workflows
- Zep: A Temporal Knowledge Graph Architecture for Agent Memory
- From CVE Entries to Verifiable Exploits: An Automated Multi-Agent Framework for Reproducing CVEs
- The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents
- Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- ReAct: Synergizing Reasoning and Acting in Language Models
Related papers
- Programmable Probabilistic Computer with 1,000,000 p-bits
- BatchGen: An Architecture for Scalable and Efficient Batch Inference
- Seamless Reconfiguration for DAG-BFT (Technical Report)
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- TIRx: A Unified Tile Primitive ML Compiler Across Heterogeneous Backends