Understanding the Energy Cost of Quantized Agents on Shared GPUs
cs.PF
Submitted: 2026-10-30
Updated: 2026-11-02
Code: https://github.com/SWE-agent/mini-s
Terminology
Sources
- Where Do the Joules Go? Diagnosing Inference Energy Consumption
- Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving
- Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agents
- When Is Smaller Greener? Right-Sizing Language Models for Agentic AI
Related papers
- Instruction-Aware Transfer of GPU Implementation Crossovers: a Tensor-Product Discontinuous Galerkin Operator on GB200, H100, and A100
- denet, A lightweight command-line tool for process monitoring in benchmarking and beyond
- HybridQC: Hardware-Grounded Simulation of Tightly Integrated Hybrid Quantum-Classical Systems
- TileBench: A Controlled Benchmark for Performance Evaluation and Bottleneck Diagnosis of Tile-Based Programming Models
- The M/PH 2/1 Queue: Explicit Distributions, Sojourn Times and Numerical Benchmarks
- Rolling Round-Robin Rate: Standard Heterogeneous Throughput for SPEC CPU