Joint Detection of Fraud and Concept Drift inOnline Conversations with LLM-Assisted Judgment
cs.CL, cs.AI, cs.LG
Submitted: 2025-05-07
Updated: 2026-10-29
Code: https://github.com/senolali/jointframework
License: http://creativecommons.org/licenses/by/4.0/
The gist: Detecting fake interactions in digital communication platforms remains a challenging and insufficiently addressed problem.
Terminology
Abstract
Detecting fake interactions in digital communication platforms remains a challenging and insufficiently addressed problem. These interactions may appear as harmless spam or escalate into sophisticated scam attempts, making it difficult to flag malicious intent early. Traditional detection methods often rely on static anomaly detection techniques that fail to adapt to dynamic conversational shifts. One key limitation is the misinterpretation of benign topic transitions referred to as concept drift as fraudulent behavior, leading to either false alarms or missed threats. We propose a two stage detection framework that first identifies suspicious conversations using a tailored ensemble classification model. To improve the reliability of detection, we incorporate a concept drift analysis step using a One Class Drift Detector (OCDD) to isolate conversational shifts within flagged dialogues. When drift is detected, a large language model (LLM) assesses whether the shift indicates fraudulent manipulation or a legitimate topic change. In cases where no drift is found, the behavior is inferred to be spam like. We validate our framework using a dataset of social engineering chat scenarios and demonstrate its practical advantages in improving both accuracy and interpretability for real time fraud detection. To contextualize the trade offs, we compare our modular approach against a Dual LLM baseline that performs detection and judgment using different language models.
Sources
- Detecting fake review buyers using network structure: Direct evidence from Amazon
- GPT-4 Technical Report
- Fraud detection in telephone conversations for financial services using linguistic features
- Are You for Real? Detecting Identity Fraud via Dialogue Interactions
- Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributes
- Structural colors with embedded anti-counterfeit features fabricated by laser-based methods
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data