TTHE: Test-Time Harness Evolution

Test-Time Harness Evolution (TTHE) optimizes an AI agent's execution program (harness) during evaluation without changing the underlying model or needing human labels. It iteratively refines a population of candidate harnesses by observing execution traces and using proxy signals to select the best harness for subsequent inputs, leading to improved grounding and verification policies.

Open the full episode

More from AI Radio