Uncovering the Memory Hierarchy of Modern NVIDIA GPUs for Accurate Simulation
cs.AR
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/cloudcores/CuAssembler
Terminology
Sources
- Layer Normalization
- Gaussian Error Linear Units (GELUs)
- Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarking
- DGNA: Dissecting GPU NUMA Architecture through Microbenchmarking and Data Analysis
- GPT-4 Technical Report
- GLU Variants Improve Transformer
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design