MedPriv-Bench: Benchmarking the Privacy-Utility Trade-off of Large Language Models in Medical Open-Ended Question Answering
The episode discusses 'MedPriv-Bench,' a benchmark designed to quantify the privacy-utility trade-off of LLMs in medical question answering. Hosts explain that contextual leakage—where unique patient details allow re-identification—is a major threat. The paper introduces a multi-agent pipeline and new metrics to rigorously measure this risk.