From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detection
This episode discusses the paper "From Lab to Reality," evaluating Deep Learning Models and LLMs for finding code vulnerabilities. The hosts conclude that current AI models fail to generalize across different datasets and struggle to accurately represent vulnerable code. They are excellent at passing lab tests but not ready for real-world security auditing due to poor cross-dataset performance.