SpikingVLA: Asynchronous Spiking Vision-Language-Action Models
cs.CL
Submitted: 2026-10-07
Updated: 2026-10-07
License: http://creativecommons.org/licenses/by/4.0/
The gist: ANN-to-SNN conversion offers a practical route toward energy-efficient spiking Vision-Language-Action (VLA) models by bypassing the substantial cost of training large-scale SNNs from scratch.
Abstract
ANN-to-SNN conversion offers a practical route toward energy-efficient spiking Vision-Language-Action (VLA) models by bypassing the substantial cost of training large-scale SNNs from scratch. However, existing methods often require many timesteps to maintain competitive performance, resulting in substantial inference latency for real-time VLA deployment. To address this challenge, we introduce SpikingVLA, an ANN-to-SNN conversion framework that enables accurate and low-latency spiking VLA inference. Specifically, we propose a Dendritic Integrate-and-Fire (DIF) neuron that alleviates channel-wise activation outliers through dendritic mixing and adaptive somatic firing, enabling accurate ANN-to-SNN conversion with fewer timesteps. Building on DIF neurons, we further introduce an asynchronous execution mechanism that overlaps temporal computation across VLA components, reducing synchronization overhead and latency. Extensive experiments demonstrate that SpikingVLA achieves competitive navigation performance with substantially improved inference efficiency. Compared with existing spiking VLA methods, SpikingVLA improves SR and SPL by 11.9% and 12.6%, respectively, while reducing first-action latency by 11.2 times. These results establish SpikingVLA as a practical framework for deploying pretrained VLA models with high-performance and low-latency spiking inference.
Sources
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks
- Matterport3D: Learning from RGB-D Data in Indoor Environments
- NaVILA: Legged Robot Vision-Language-Action Model for Navigation
- Toward Large-scale Spiking Neural Networks: A Comprehensive Survey and Future Directions
- Differential Coding for Training-Free ANN-to-SNN Conversion
- OpenVLA: An Open-Source Vision-Language-Action Model
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- A Survey on Vision-Language-Action Models for Embodied AI
- SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
- Gemini Robotics: Bringing AI into the Physical World
- Spiking Vision Transformer with Saccadic Attention
- StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modeling
- TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM
- SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
- QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
- Neural Dynamics Self-Attention for Spiking Transformers
- QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Models
- Spikformer: When Spiking Neural Network Meets Transformer
- SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering