High-speed Imaging through Turbulence with Event-based Light Fields
cs.CV
Submitted: 2026-03-14
Updated: 2026-09-22
Comments: Accepted at ECCV 2026. Project page: https://justhowww.github.io/lf-ev-turb-project-page/
Journal ref: Computer Vision - ECCV 2026, Lecture Notes in Computer Science, vol. 17066, pp. 632-649, Springer, Cham, 2026
DOI: 10.1007/978-3-032-37718-0_36
Project page: https://justhowww.github.io/lf-ev-turb-project-page
License: http://creativecommons.org/licenses/by/4.0/
The gist: This work introduces and demonstrates the first system capable of imaging fast-moving extended non-rigid objects through strong atmospheric turbulence at high frame rate.
Terminology
Abstract
This work introduces and demonstrates the first system capable of imaging fast-moving extended non-rigid objects through strong atmospheric turbulence at high frame rate. Event cameras are a novel sensing architecture capable of estimating high-speed imagery at thousands of frames per second. However, on their own event cameras are unable to disambiguate scene motion from turbulence. In this work, we overcome this limitation using event-based light field cameras: By simultaneously capturing multiple views of a scene, event-based light field cameras and machine learning-based reconstruction algorithms are able to disambiguate motion-induced dynamics, which produce events that are strongly correlated across views, from turbulence-induced dynamics, which produce events that are weakly correlated across view. Tabletop experiments demonstrate event-based light field can overcome strong turbulence while imaging high-speed objects traveling at up to 16,000 pixels per second.
Sources
- Guidestar-Free Adaptive Optics with Asymmetric Apertures
- EGTM: Event-guided Efficient Turbulence Mitigation
- EvTurb: Event Camera Guided Turbulence Removal
- Neuromorphic Shack-Hartmann wave normal sensing
- Spectral Norm Regularization for Improving the Generalizability of Deep Learning
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models