Large Language Models Pass the History Exam But Miss the «History»: A Polish High School Exit Exam Matura Benchmark
A study benchmarked eight large language models against the Polish Matura history exam, finding they scored significantly higher than human averages. However, hosts discuss how these models fail to grasp cultural specifics and temporal reasoning. They pass based on knowledge retrieval but not on deep historical inquiry or contextual understanding.