When Is High-Bandwidth Flash Cost-Effective for LLM Inference?
cs.AR
Submitted: 2026-11-08
Updated: 2026-11-08
Code: https://github.com/ryeii/When-Is-HBF-Cost-Effective
Terminology
Sources
- HBF Sucks! A Full-Stack Characterization of High-Bandwidth Flash for KV-Centric LLM Serving
- FlashAccel: Leveraging High-Bandwidth Flash for High-Throughput LLM Inference
- Frontier: Towards Comprehensive and Accurate LLM Inference Simulation
- LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure
- TraceLab: Characterizing Coding Agent Workloads for LLM Serving
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design