Elastic Precision: Software-Hardware Co-Design of a Mixed-Precision Architecture for Long-Context LLM Inference
cs.AR
Submitted: 2026-10-31
Updated: 2026-10-31
Terminology
Sources
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- The Llama 3 Herd of Models
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- FGMP: Fine-Grained Mixed-Precision Weight and Activation Quantization for Hardware-Accelerated LLM Inference
- RULER: What's the Real Context Size of Your Long-Context Language Models?
- Efficient Memory Management for Large Language Model Serving with PagedAttention
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
- Low Mach number limit and optimal time decay rates of the compressible Navier-Stokes-transport system in critical Besov spaces
- Combating the Memory Walls: Optimization Pathways for Long-Context Agentic LLM Inference
- No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design