Bye-bye, Bluebook? Automating Legal Procedure with Large Language Models
The episode reviews a paper testing if Large Language Models can automate legal procedure using Bluebook citations. Testing five AI models on 866 tasks, accuracy ranged from 69% to 74%. The hosts conclude that AI is not ready for legal work because the models rely on memorization rather than applying rules, making them unreliable for complex procedural tasks.