PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
PackMonitor is a training-free system designed to eliminate package hallucinations in LLMs by monitoring their decoding process in real-time. It works by detecting when models generate package names and then intervening to block invalid suggestions using a deterministic finite automaton based on an authoritative list of packages. This ensures zero package hallucinations with minimal performance impact.