From Retrieved Evidence to Security Outcomes: A Data-Driven Analysis of Java Security API Misuse in LLM-Generated Code
The research tested how different AI models (GPT-5.5 and Llama-3.3) handle Java security API misuse when given external security knowledge. While both models show persistent misuse, external knowledge significantly improves outcomes, but the most effective type of knowledge differs by model capability.