SlipStream: Enabling HBF for GPU Systems by Mitigating the Latency and SRAM Overheads
cs.AR, cs.DC, cs.LG
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/NVIDIA/TensorRT-LLM
Terminology
Sources
- The Llama 3 Herd of Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
- HAVEN: High-Bandwidth Flash Augmented Vector Engine for Large-Scale Approximate Nearest-Neighbor Search Acceleration
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
- Microbenchmarking NVIDIA's Blackwell Architecture: An in-depth Architectural Analysis
- Qwen2 Technical Report
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
- FlashAccel: Leveraging High-Bandwidth Flash for High-Throughput LLM Inference
- Mixtral of Experts
- DeepSeek-V3 Technical Report
- Qwen3 Technical Report
- Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip
- PRESERVE: Prefetching Model Weights and KV-Cache in Distributed LLM Serving
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design