Evaluating Inference Compute for Generative AI: A Framework for Enterprise Workloads
cs.AR, cs.DC, cs.LG, cs.PF
Submitted: 2026-10-05
Updated: 2026-10-05
Terminology
Sources
- Why Do Multi-Agent LLM Systems Fail?
- AI Agents That Matter
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Survey on Evaluation of LLM-based Agents
Related papers
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design
- PoisonCap: Efficient Hierarchical Temporal Safety for CHERI
- Provisioning to Runtime Optimization of a 100 MW-Scale AI Cluster
- Bit-Accurate Modeling of GPU Matrix Multiply-Accumulate Units: Demystifying Numerical Discrepancy and Accuracy