Grounding Probes: Generator-Independent Hallucination Detection from Observer Model Hidden States

arXiv:2610.04642 · cs.CL · Submitted 2026-10-03 · Read on arXiv

cs.CL

Submitted: 2026-10-03

Updated: 2026-10-03

Comments: 13 pages, 4 figures, 4 tables. Code and per-sample predictions: https://github.com/MRathmayr/LettuceDetect

Code: https://github.com/MRathmayr/LettuceDetect

License: http://creativecommons.org/licenses/by/4.0/

The gist: Detecting responses that retrieval-augmented generation does not ground in its context trades speed against accuracy: surface checks miss paraphrased fabrication, sampling-based methods cost extra

Terminology

Abstract

Detecting responses that retrieval-augmented generation does not ground in its context trades speed against accuracy: surface checks miss paraphrased fabrication, sampling-based methods cost extra generations. Hidden-state probes sit between the two, but every existing one reads the generating model's own activations, so a change of generator invalidates the detector and a closed-weight generator is out of reach. This paper removes that coupling. The Grounding Probe is logistic regression over the mean-pooled middle-layer hidden states of an observer language model that reads the context, question, and response in one forward pass and generates nothing, with the recipe it needs: pool over response tokens, read a middle layer, and control capacity, which closes the train-test AUROC gap from 0.087-0.202 to 0.009-0.013. Asking the observer outright, rather than reading its hidden state, costs at least +0.166 AUROC in every one of four models. Fitted on 15,090 annotated responses it reaches 0.879-0.894 AUROC on RAGTruth test across four observers, and 0.924 AUROC with 0.820 F1@0.5 averaged with a supervised span detector, 0.060 above that detector alone. One probe holds across six generators, and hold-out controls, including one in which no evaluation prompt appears in training, bound the cost of removing a generator at about 0.02 AUROC. Code, probes, and predictions are released.

Sources

Related papers