ScamWorld: An Interactive Environment for Evaluating Web Agents Against Online Fraud
cs.AI
Submitted: 2026-11-03
Updated: 2026-11-04
Code: https://github.com/almakhamreh/Multimodal-PhishingBenchmarks
Project page: https://web.archive.org
Terminology
Sources
- DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents
- PhreshPhish: A Real-World, High-Quality, Large-Scale Phishing Website Dataset and Benchmark
- LoginTrap: Uncovering Task-Agnostic Phishing-Style Indirect Prompt Injection Attacks against LLM-based Web Agents
- RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation
- Anansi: Scalable Characterization of Message-Based Job Scams
- "I Strongly Suspect This Website Is a Scam": Benchmarking PII Leakage and Detection without Defense in Autonomous Web Agents
- When Bots Take the Bait: Exposing and Mitigating the Emerging Social Engineering Attack in Web Automation Agent
- Internal Safety Collapse in LLMs and Coding Agents
- ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checking
- FraudSMSWalker: Benchmarking Agentic Large Language Models for SMS-to-Webpage Fraud Detection
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents