Fast Entropy Decoding for Sparse MVM on GPUs
cs.PF, cs.DC, cs.MS
Submitted: 2026-03-02
Updated: 2026-11-06
Code: https://github.com/PAA-NCIC/AlphaSparse
Terminology
Sources
- SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
- Asymmetric numeral systems: entropy coding combining speed of Huffman coding with compression rate of arithmetic coding
- Kokkos Kernels: Performance Portable Sparse/Dense Linear Algebra and Graph Kernels
Related papers
- Instruction-Aware Transfer of GPU Implementation Crossovers: a Tensor-Product Discontinuous Galerkin Operator on GB200, H100, and A100
- denet, A lightweight command-line tool for process monitoring in benchmarking and beyond
- HybridQC: Hardware-Grounded Simulation of Tightly Integrated Hybrid Quantum-Classical Systems
- TileBench: A Controlled Benchmark for Performance Evaluation and Bottleneck Diagnosis of Tile-Based Programming Models
- The M/PH 2/1 Queue: Explicit Distributions, Sojourn Times and Numerical Benchmarks
- Rolling Round-Robin Rate: Standard Heterogeneous Throughput for SPEC CPU