Streamlined optical training of large-scale modern deep learning architectures with direct feedback alignment
The episode discusses a paper titled "Streamlined optical training of large-scale modern deep learning architectures with direct feedback alignment." The hosts detail how this method uses light and optical processors to train massive neural networks, showing improvements in parallel training, better scaling beyond GPU memory limits, and robustness to noise compared to standard backpropagation.