Can SGD Select Good Fishermen? Local Convergence under Self-Selection Biases
The episode discusses 'Can SGD Select Good Fishermen? Local Convergence under Self-Selection Biases,' arguing that assuming unbiased data is dangerously naive for AI optimization. Experts conclude that building trustworthy systems requires modeling data generation processes and quantifying selection biases, moving beyond simply minimizing observed loss.