TinyML Hits the Memory Wall: A Benchmark of Ten Sub-Watt Edge Devices
cs.AR
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/mlcommons/tiny_results_v1.4
Terminology
Sources
- CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUs
- Performance Analysis of Edge and In-Sensor AI Processors: A Comparative Review
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Evaluating the Energy Efficiency of NPU-Accelerated Machine Learning Inference on Embedded Microcontrollers
- SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design