Towards an Expressivity-Normalized Energy-Demand Comparison of ANNs and SNNs
The episode discusses a paper comparing Artificial Neural Networks (ANN) and Spiking Neural Networks (SNN) using a detailed energy model. The hosts analyze how energy demand scales with network depth, width, and input dimensions. They conclude that efficiency depends on specific design thresholds related to sparsity, width, and scaling factors.