When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning
Researchers tested if large language models can correctly determine which version of a law applies to a case based on when events happened. Findings show models strongly prefer newer laws, regardless of facts, and that reinforcement learning reduces reasoning diversity. Success requires task-specific guidance rather than just better general reasoning.