When AI Is Your Pastor: A Benchmark for Theological Triage and Pastoral Guidance in Large Language Models
The episode discusses Alex Chao's paper, "When AI Is Your Pastor: A Benchmark for Theological Triage and Pastoral Guidance in Large Language Models." The hosts review how a benchmark called FMG-Bench tested fourteen AI models using theological triage to sort questions. Key findings show structured harnesses improve scores, especially for safety-critical escalation, but caution against over-engineering and the dangers of comparative questioning.