Shorter, but Still Trustworthy? An Empirical Study of Chain-of-Thought Compression
This episode explores a paper investigating how compressing chain-of-thought reasoning affects model trustworthiness. The hosts discuss how standard benchmarks often miss safety or multilingual regressions caused by compression. They conclude that while compression can be risky, using methods like alignment-aware DPO can maintain safety while increasing efficiency.