Wire-Level Interrupt-to-Decision Latency of On-Sensor MLC versus Host Inference on the NVIDIA Jetson Orin Nano: A Pre-Registered Measurement Study
This study measured how long it takes for a sensor interrupt to trigger a decision on an NVIDIA Jetson Orin Nano using either a host computer or an onboard Machine Learning Core (MLC). The results show that the host inference method has lower latency than the MLC pipeline under all tested conditions. The primary bottleneck is not the ML core's calculation, but rather the overhead of reading data via I2C protocols.