Unveiling Spectral Mechanisms in Training-Free LLM Text Detection
cs.CL
Submitted: 2026-08-26
Updated: 2026-08-27
Code: https://github.com/TrustMedia-zju/Lastde_Detectorhttps:
License: http://creativecommons.org/licenses/by/4.0/
The gist: The rapid advancement of Large Language Models (LLMs) makes it increasingly difficult to distinguish human writing from machine-generated text.
Terminology
Abstract
The rapid advancement of Large Language Models (LLMs) makes it increasingly difficult to distinguish human writing from machine-generated text. Training-free detection offers a scalable solution, yet common confidence-based metrics mainly measure average token probabilities and often miss the signal fluctuations that characterize human writing, which we call "generative vitality". Spectral analysis offers a way to capture this vitality, but its mechanism and practical boundaries remain underexplored. In this paper, we analyze spectral detection from both theoretical and empirical perspectives. We connect spectral energy to variance in proxy log-probability trajectories and explain how broader human token choices create the fluctuations used by frequency-domain indicators. We further show that the strength of this signal depends on text length and sampling range: spectral evidence is clearest for long, continuous, constrained generation, while short, fragmented, mixed, and edited settings require complementary confidence and fluctuation views. These findings clarify when frequency-domain detection works and provide guidance for future multi-dimensional detector design.
Sources
- GPT-4 Technical Report
- Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
- ELI5: Long Form Question Answering
- Hierarchical Neural Story Generation
- GLTR: Statistical Detection and Visualization of Generated Text
- Automatic Detection of Generated Text is Easiest when Humans are Fooled
- Robust and Fine-Grained Detection of AI Generated Texts
- SpecDetect: Simple, Fast, and Training-Free Detection of LLM-Generated Text via Spectral Analysis
- Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
- Release Strategies and the Social Impacts of Language Models
- DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Text
- HACo-Det: A Study Towards Fine-Grained Machine-Generated Text Detection under Human-AI Coauthoring
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection
- Training-free LLM-generated Text Detection by Mining Token Probability Sequences
- DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering