Measuring Epistemic Humility in Multimodal Large Language Models
The authors created HumbleBench, a new evaluation benchmark for multimodal models to test 'false-option rejection.' Instead of just checking if a model gets the right answer, it forces models to choose 'None of the above' when no option is correct. This measures epistemic humility—a model's awareness of its knowledge limits—showing that accuracy alone doesn't reflect true robustness.