Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure
summary
The gist
Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure extends FLYNN by integrating a 32-ray 2D LiDAR interface into a fly connectome network to improve navigation when vision fails The…
In short
Researchers extended a fly navigation network (FLYNN) by adding a 32-ray 2D LiDAR interface to improve robot navigation when vision fails. The integration involves projecting LiDAR data onto fly whisker neurons using fixed weights and a learned scalar gain. FLYNN-LiDAR significantly boosts success rates under total vision loss, out-of-distribution textures, and periodic dropout compared to baselines.
Key concepts
- FLYNN
- A recurrent neural network designed for robot navigation based on the topology of the fly brain. It processes sensory input through a series of interconnected neurons that learn how to navigate environments by integrating information across these biological pathways.
- LiDAR Interface
- A mechanism to introduce 32-ray 2D LiDAR scan data into the fly's neural network. This is done by projecting the scan onto specific head-bristle neurons with fixed weights and a single learned scalar gain, allowing the network to use range information.
- Total Vision Loss Robustness
- The ability of FLYNN-LiDAR to maintain high navigation success even when visual input is completely lost. The LiDAR scan provides crucial spatial context during these failures, significantly increasing performance compared to models relying solely on vision.
Terminology used across episodes
This episode discusses
- Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure · Paper Radio
- FLYNN: Robust Neural Network for Robot Navigation using Fly Brain Topology
The paper
Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure · Read on arXiv
We extend FLYNN, a leaky integrator recurrent network wired on the Drosophila melanogaster connectome, with a 32-ray 2D LiDAR interface that requires no learned fusion layer beyond a scalar input gain. A 270 degree frontal scan at 8 m range is injected as inverted proximity into the 37 BM Vib head-bristle neurons. Across 24 paired comparisons in a four- state vision matrix with LiDAR on or off, FLYNN-LiDAR has 17 significant wins, 5 nonsignificant comparisons, and 2 significant losses against three LiDAR-capable baselines. Both losses are to MobileNet with the left eye off. With full vision, FLYNN- LiDAR reaches 96.6% success. Under total vision loss, the scan raises success from 45.2% to 64.6%; the baselines reach 44.6% to 56.6% with the scan on. Under out of distribution textures, it is the only LiDAR-capable model whose success improves with the scan (44.2% to 58.4%); both CNNs score 0%, and SmallWorld declines from 26.8% to 7.4%. Under periodic vision dropout, FLYNN-LiDAR achieves 93.6% and 89.6% success at 25% and 50% duty with fewer collisions. Profiling the evaluated forward paths gives 3.93M multiply accumulate operations per step; EfficientNet and MobileNet require 4.60x and 2.94x as many. Final- state analysis shows near-linear sensory superposition (cosine 0.9955).
Transcript
Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.
Ines: I'm Ines.
Marcus: And I'm Marcus, here with Yuki.
Ines: We're looking at the paper: "Fly Whiskers Meet LiDAR".
Marcus: Here's the gist of the paper. Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure extends FLYNN by integrating a 32-ray 2D LiDAR interface into a fly connectome network to improve navigation when vision fails The strongest benefits occur under total vision loss, out of distribution (OOD) textures, and periodic dropout FLYNN-LiDAR achieves 96.6% success under full vision, whereas the baselines reach 44.6% to 56.6% with the scan on The result is not universal superiority, as MobileNet retains a significant left-eye-off advantage Sensor Integration and Mechanism The LiDAR interface involves injecting a fixed, spatially ordered projection of a 32-ray 2D LiDAR scan into the 37 BM Vib head-bristle neurons This projection has fixed weights and one learned scalar input gain, which is integrated in the recurrent network The scan is represented by encoding each continuous range as 1 − r/8, where zero denotes free space and one denotes contact Rays are assigned by hemifield to the nearest of 18 left and 19 right BM Vib afferents in a fixed midline-to-lateral map The LiDAR-to-whisker mapping preserves true anatomical laterality, unlike the small-world control where laterality is assigned by convention Performance Under Stress Conditions The robustness of FLYNN-LiDAR is demonstrated across several failure modes and conditions The strongest benefits occur under total vision loss, out of distribution (OOD) textures, and periodic dropout Under total vision loss, the scan raises success from 45.2% to 64.6%, while baselines reach 44.6% to 56.6% with the scan on Under out of distribution textures, it is the only LiDAR-capable model whose success improves with the scan, rising from 44.2% to 58.4% Under periodic vision dropout at 25% and 50% duty, FLYNN-LiDAR achieves 93.6% and 89.6% success with fewer collisions Comparative Analysis and Efficiency FLYNN-LiDAR shows significant wins against three LiDAR-capable baselines across 24 paired comparisons Against EfficientNet, MobileNet, and SmallWorld, FLYNN-LiDAR has 17 significant wins after Bonferroni correction Under full vision with LiDAR, FLYNN-LiDAR leads the best of the three LiDAR-capable baselines by 7.8 points Profiling evaluated forward paths yields 3.93M multiply accumulate operations per step for FLYNN-LiDAR, which is less than EfficientNet and MobileNet This suggests that while it shows gains, it does not achieve orders of magnitude advantage in computational efficiency compared to CNNs State Geometry and Limitations The near-linear sensory superposition persists with the scan, as the cosine is 0.9955 for FLYNN-LiDAR with LiDAR Under total vision loss, full-dimensional Fisher-style meandifference scores are 1.07 for FLYNN-LiDAR and 2.90 for SmallWorld However, the lateral effect is model-dependent, as MobileNet reverses the ordering of left/right off performance Limitations include evaluations in simulation with one planar robot and one connectome instance, meaning training-seed variance and the origin of lateral asymmetry remain unresolved The LiDAR-off condition for FLYNN-LiDAR is an ablation of a policy trained with the scan, not a separately trained baseline The energy estimates omit memory and sensor costs, and state-geometry analyses are correlational rather than causal A fixed 32-ray projection can add range input to the fly whisker pathway with only a learned scalar input gain FLYNN-LiDAR shows its strongest robustness under total vision loss, OOD textures, and periodic flicker Multi-seed training, realistic scan noise and refresh, and hardware evaluation are necessary next steps The project repository is https://github.com/Ali-Mahzarnia/flynn-lidar (public release at publication) REFERENCES 2611.03897 2611.03897 2611.03897 4 4 4 5 5 5 Page 1 --- 1 Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure Ali Mahzarnia and Homayoun Jamshidi Abstract—We extend FLYNN, a leaky integrator recurrent network wired on the Drosophila melanogaster connectome, with a 32-ray 2D LiDAR interface that requires no learned fusion layer beyond a scalar input gain.
Ines: A 270 degree frontal scan at 8 m range is injected as inverted proximity into the 37 BM Vib head-bristle neurons.
Marcus: Across 24 paired comparisons in a fourstate vision matrix with LiDAR on or off, FLYNN-LiDAR has 17 significant wins, 5 nonsignificant comparisons, and 2 significant losses against three LiDAR-capable baselines.
Ines: Both losses are to MobileNet with the left eye off.
Paper summary: Ines: So we're wrapping up this look at "Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure". Basically, these researchers extended a network based on the fly brain called FLYNN by adding a way to take in range data from a LiDAR scanner <ref:2611.03897#pg1>.
Marcus: Right, so the core idea is that you inject this fixed thirty-two-ray scan into the neuron pathway, and they found that this setup helps navigation when vision completely fails <ref:2611.03897#pg1>.
Ines: That's the big claim, right? They show it works best when you lose all vision, or when textures are totally weird, or even if there’s a constant flicker in the input <ref:2611.03897#pg1>.
Marcus: And the numbers back that up—under total loss of vision, their success rate jumps from forty five point two percent to sixty four point six percent compared to just using the network alone <ref:2611.03897#pg1>.
Ines: It suggests that this range input is really useful for maintaining control when primary visual data disappears. What does this mean for how we think about these tiny robots?
Marcus: For us, it means we can build systems that don't rely on a single type of sensor being perfect; having multiple ways to sense the world makes the whole thing way more stable <ref:2611.03897#pg1>.
Marcus: So, while it’s a solid addition to the fly connectome architecture, we need to see if those gains hold up when we move this into real hardware with noisy data <ref:2611.03897#pg1>.
Conclusion: Ines: So we're wrapping up our look at "Fly Whiskers Meet LiDAR: Robust Navigation under Sensor Failure". The main point here is that they took an existing network, FLYNN, and successfully gave it a way to use range data from a LiDAR scanner without needing any extra fusion layer beyond just a learned scalar input gain.
Marcus: Exactly. They showed that injecting this fixed thirty-two-ray scan into the fly whisker pathway helps navigation when vision completely fails or when the textures are totally weird.
Ines: That's what they claim, right? They found success rates jumping from forty five point two percent to sixty four point six percent under total vision loss.
Marcus: That’s a big jump for those failure conditions because the baselines didn't improve much at all when vision went down.
Ines: It means that this specific range input isn't just extra data; it fundamentally changes how the network handles sensory input under stress.
Marcus: And while they show this is robust, they also point out that the gains aren't huge in terms of raw speed compared to those other models when you look at the operations per step.
Ines: So, while it’s a solid addition to the fly connectome architecture and definitely improves resilience, we still need to see if those gains hold up when we move this into real hardware with noisy data.
Marcus: That's what we need to figure out next—how does this actually perform when it’s running in the messy world.
More episodes
- 2610.33881-Sensorimotor behavior from an untrained brain-and-nerve-cord connectome
- 2610.40344-Morphological Features of Murine Pulmonary Arterial Networks for Diagnosing Vascular Disease
- Daily Summary for 2026-11-19
- 2609.10193-Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets
- 2610.38236-Generative discovery of chemical reaction networks
- 2507.11176-An Interpretable AI framework Quantifying Traditional Chinese Medicine Principles Towards Enhancing and Integrating with Modern Biomedicine
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2504.03590-Towards a Unified Framework for Determining Conformational Ensembles of Disordered Proteins
- 2603.15217-A multiscale discrete-to-continuum framework for structured population models