Sub-100KB On-Device CNN Training via Dynamic Sparse Updates and Hardware--Software Co-Design
cs.AR
Submitted: 2026-11-11
Updated: 2026-11-11
Terminology
Sources
- Pruning Filters for Efficient ConvNets
- The State of Sparsity in Deep Neural Networks
- TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning
- Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs
- On-Device Training Under 256KB Memory
- TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge
- VanillaKD: Revisit the Power of Vanilla Knowledge Distillation from Small Scale to Large Scale
- Visual Wake Words Dataset
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design