Measuring Iterative Temporal Reasoning with Time Puzzles

Time Puzzles introduced a new constraint-based date inference task to evaluate how large language models perform iterative temporal reasoning when using external tools like web search or Code Interpreter. The research found that while tool use helps, models perform best when constraints are rewritten with explicit dates rather than relying on factual lookups, suggesting a gap in reliable tool use for implicit temporal reasoning.

Open the full episode

More from AI Radio