Investigating Hyperparameter Optimization and Transferability for ES-HyperNEAT: A TPE Approach
This episode discusses a study from University of Neuchâtel on optimizing ES-HyperNEAT using TPE. The researchers found that TPE systematically optimized parameters for the MNIST task, achieving 29% accuracy efficiently. They also analyzed transferability, finding that while some settings transferred well across tasks, the approach suggests a path toward more efficient AI design.