How Far Are We From On-Device VLM Inference? A Measurement Study on Edge NPUs
cs.PF, cs.AR
Submitted: 2026-10-29
Updated: 2026-10-29
Comments: 26 pages, including references and appendices
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Related papers
- Instruction-Aware Transfer of GPU Implementation Crossovers: a Tensor-Product Discontinuous Galerkin Operator on GB200, H100, and A100
- denet, A lightweight command-line tool for process monitoring in benchmarking and beyond
- HybridQC: Hardware-Grounded Simulation of Tightly Integrated Hybrid Quantum-Classical Systems
- TileBench: A Controlled Benchmark for Performance Evaluation and Bottleneck Diagnosis of Tile-Based Programming Models
- The M/PH 2/1 Queue: Explicit Distributions, Sojourn Times and Numerical Benchmarks
- Rolling Round-Robin Rate: Standard Heterogeneous Throughput for SPEC CPU