Aftab: A Comprehensive Benchmark of CNN Encoders and Advanced Value Functions in Parallelized Q-Networks
The episode reviews the paper 'Aftab: A Comprehensive Benchmark of CNN Encoders and Advanced Value Functions in Parallelized Q-Networks' from the University of Padua. The hosts discuss how Aftab redesigns the standard CNN encoder in buffer-free reinforcement learning, achieving an IQM of 6.479 on Atari-57, more than doubling the PQN baseline of 2.692. They highlight the architectural choices, parameter discipline, and the paper's honest limitations compared to replay-buffer systems.