PolyWorkBench: Benchmarking LLM Agents for Cross-Lingual Long-Horizon Workflows
The episode discusses 'PolyWorkBench,' a benchmark for LLM agents that tests cross-lingual, long-horizon workflows across five workplace domains. Hosts analyze how current models struggle with tasks requiring multiple languages and multi-step planning. They conclude that agent evaluation must consider language interaction, not just single metrics.