Encoded but Not Routed: Explaining the Table-Chart Gap in Scientific Claim Verification
Researchers investigated why multimodal AI models struggle to verify scientific claims supported by charts compared to tables. They found that chart information is encoded within the model's internal representations but fails to reach the final decision-making stage. This disparity is not due to poor initial understanding, but rather a failure in routing that directs visual evidence toward the prediction layer.