Tracer: A Forensic Framework for Detecting Fraudulent Speedruns from Game Replays
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.
Tom: We're looking at the paper: "Tracer: A Forensic Framework for Detecting Fraudulent Speedruns from Game Replays".
Jane: Here's the gist of the paper. Tracer proposes Tamper Recognition via Analysis of Continuity and Events in game Runs, a modular framework for identifying artefacts of manipulation in speedrun submissions The paper presents a structured academic approach to systematically investigate fraudulent activities within ludic metagaming communities This framework grounds its analysis in audiovisual forensics, physical laws, human and hardware limitations, and cyberspace anomaly detection It offers a generalisable set of evaluative heuristics for game replay analysis that can lower the cost of manual review.
Tom: The Problem in Ludic Metagaming Culture Increased visibility has introduced risks, leading some individuals to resort to deceptive shortcuts such as staged setups, plagiarised footage, or spliced runs These forged submissions exploit the trust-based ecosystem of speedrun communities.
Jane: Criminological theories suggest that manipulation is facilitated by the convergence of a motivated offender, a suitable target, and the absence of a capable guardian Deterrence Theory indicates that misconduct is deterred only when certainty, celerity, and severity of punishment are present.
Tom: Rational Choice Theory posits that actors may commit crime if the perceived benefits outweigh the risks of being caught.
Title and authors: Tom: So, let's talk about the title and who wrote this, "Tracer: A Forensic Framework for Detecting Fraudulent Speedruns from Game Replays." It sets the stage immediately for what we're looking at.
Jane: And it comes from JAEUNG FRANCISKUS YOO and HUY KANG KIM from Korea University. They’ve clearly put some serious thought into the problem of forged speedruns in those ludic metagaming communities.
Lu: What I find interesting is how they frame the problem, moving it beyond just anecdotal documentation to a structured academic approach that investigates fraudulent activities systematically.
Meng: So, what's the basic summary? What exactly is Tracer doing in plain language for someone who isn't deep in game analysis?
Tom: Well, essentially, Tracer is proposing a modular framework designed to identify artifacts of manipulation within speedrun submissions. It’s not just one single tool; it’s a collection of different analytical methods working together.
Jane: They ground this framework in three main domains where manipulation can happen: the physical world, the human-computer interface, and cyberspace itself.
Lalam: That means they're looking at everything from how fast a person can physically react to what’s happening inside the game's logic or rendering.
The paper's summary: Tom: They break down their analysis into three specific dimensions: Physics Coherence, Media Continuity, and Cyberspace Consistency. These sound like they map nicely onto the different ways someone can cheat a speedrun.
Jane: Physics Coherence checks if the inputs and execution patterns make sense given human and hardware constraints. It’s about checking if the player *could* have done that physically or technically.
Lu: And then we have Media Continuity, which targets audiovisual inconsistencies in footage, focusing on frame-level inspection to catch things like abrupt scene transitions or jittering HUD elements.
Meng: That sounds incredibly tedious if you're doing it manually across a hundred hours of gameplay footage. How do they handle the scale of that kind of review?
Tom: They address that by proposing a five-step forensic process pipeline: Evidence Acquisition, Artefact Normalisation, Event Attribution, Analytical Review, and finally Verdict Synthesis.
Jane: The key part for me is that the analytical review phase uses domain-specific heuristics to flag those inconsistencies or manipulative artifacts we discussed earlier.
Lalam: And they’re trying to make it so that these structured guidelines can lower the cost of manual review by giving reviewers a clear set of rules to follow.
The paper's improvements: Tom: The authors suggest several concrete improvements to this initial framework, and those are pretty cool because they show they’re thinking about how to make it better.
Jane: They suggest enhancing the Physics Coherence Module by explicitly checking for implausible input sequences, like timing that falls below human reaction thresholds or exceeds hardware limits when cross-referencing handcam footage with in-game outcomes.
Lu: That ties directly into what we mean by physical coherence; it’s not just about general plausibility, it’s about specific mechanical limits, like key rollover limits on a keyboard.
Meng: I like the idea of automating the Cyberspace Consistency Module to perform probabilistic inconsistencies checks by reverse-analyzing PRNG logs for games that have deterministic mechanics. That would be way more scalable than just looking at visuals alone.
Tom: And they also propose integrating evidence acquisition and artefact normalization by extracting frame-level input timestamps and quantifying game-specific metrics like barter count or movement paths from the raw evidence.
Jane: That structured data extraction is crucial because it turns messy footage into a representation that the AI can actually analyze effectively later on.
Lalam: And they also suggest automating event attribution to map observed events directly into those physical, HCI, or cyberspace domains before applying the specific heuristics during the analytical review phase.
Conclusion: Tom: So, to wrap up this paper on "Tracer: A Forensic Framework for Detecting Fraudulent Speedruns from Game Replays," it’s proposing a structured academic approach using audiovisual forensics and anomaly detection to spot manipulation in speedrun submissions.
Jane: The main implication is that we can move beyond just anecdotal evidence and establish a more rigorous, systematic way to investigate fraudulent activities in these communities.
Lu: This framework offers a generalisable set of evaluative heuristics, which means it provides a foundation for future tooling, even if the current implementation isn't fully automated.
Meng: For us shipping models at scale, the real value is in getting those structured guidelines so we know what kind of anomalies to prioritize when we eventually build automated detection tools.
Lalam: And they are aiming for that automation by harvesting gameplay logs for input or memory trace collectors, which could feed into anomaly detection models.
Tom: So, the paper shows a path forward from manual review to more structured analysis based on physical laws and game logic. It’s a solid foundation for improving how we verify submissions in this space.
Jane: It definitely gives us a concrete set of things to look for when evaluating those speedrun videos moving forward.
Korea University
cs.HC, cs.CY
Submitted: 2025-09-13
Updated: 2026-11-12
Comments: 16 pages, 8 figures. Extended version of the paper in Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY Companion 25), New York, NY, USA, October 2025
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
Importance score: 77/100
The gist: Tracer proposes Tamper Recognition via Analysis of Continuity and Events in game Runs, a modular framework for identifying artefacts of manipulation in speedrun submissions The paper presents a…
Key concepts
- Physical Coherence Module
- This module checks if player actions in the footage are possible given real-world limits. It verifies if inputs or execution patterns violate human reaction times or hardware limitations, such as key rollover speeds on a keyboard, ensuring the physical actions match what is plausible.
- Media Continuity Module
- This focuses on detecting manipulation in video footage by inspecting every frame. It looks for visual artifacts like sudden scene cuts, shaky heads (jittering HUD), or inconsistent audio levels that suggest parts of the run have been spliced or altered.
- Cyberspace Consistency Module
- This module checks if the game's internal logic is consistent. It uses statistical methods, especially for games with predictable mechanics, to look for anomalies in things like item drop rates or movement paths that defy the game's established rules.
Terminology
Summary
Tracer proposes Tamper Recognition via Analysis of Continuity and Events in game Runs, a modular framework for identifying artefacts of manipulation in speedrun submissions The paper presents a structured academic approach to systematically investigate fraudulent activities within ludic metagaming communities This framework grounds its analysis in audiovisual forensics, physical laws, human and hardware limitations, and cyberspace anomaly detection It offers a generalisable set of evaluative heuristics for game replay analysis that can lower the cost of manual review. p. 2 3 Tracer: A Forensic Detection Framework
To this end, we propose Tracer, Tamper Recognition via Analysis of Continuity and Events in game Runs, a modular
forensic framework for evaluation in speedrun submissions. This work makes the following contributions:
• First, this paper presents a structured academic approach to systematically investigate fraudulent activities
within ludic metagaming communities, moving beyond anecdotal documentation.Where the paper says it
The Problem in Ludic Metagaming Culture
Increased visibility has introduced risks, leading some individuals to resort to deceptive shortcuts such as staged setups, plagiarised footage, or spliced runs These forged submissions exploit the trust-based ecosystem of speedrun communities. Criminological theories suggest that manipulation is facilitated by the convergence of a motivated offender, a suitable target, and the absence of a capable guardian Deterrence Theory indicates that misconduct is deterred only when certainty, celerity, and severity of punishment are present. p. 1 All three elements are clearly present in the context of manipulated speedruns:
offenders are often skilled and motivated, digital footage is inherently malleable; and decentralised moderation lacks
both the assistive tools and consistency for enforcement. Deterrence Theory further argues that misconduct is deterred
only when all three elements are present: (a) certainty, (b) celerity, and (c) severity of punishment [22]. This combination creates an environment unusually conducive, almost ideal, to misconduct. Lastly, Rational Choice Theory [23, 24] posits that when the perceived benefits outweigh the risks of being caught, even
actors with no prior misconduct may be tempted to commit crime.Where the paper says it
Where the paper says it
Threat Model Taxonomy
The paper defines three key domains where manipulation occurs within the gameplay feedback loop: (1) the Physical World, (2) the HCI Interface, and (3) Cyberspace The Physical World includes Physiological Limits, Hardware Constraints, and Physical Law Boundaries. The HCI Interface encompasses input and output channels like keyboards and monitors Cyberspace refers to the in-game environment itself, including In-game Data, In-game Logic, and Rendering. p. 4 The Human-Computer Interaction (HCI) layer forms the boundary between the physical world
and the digital game environment. It includes all input and output channels through which gameplay is mediated:
keyboards, mice, controllers, capture cards, monitors, and screen overlays.Where the paper says it
Tracer Analytical Dimensions
Tracer organizes detection strategies into three analytical dimensions: Physics Coherence, Media Continuity, and Cyberspace Consistency The Physics Coherence Module evaluates whether observed player inputs and execution patterns are plausible within human and hardware constraints. The Media Continuity Module targets audiovisual inconsistencies resulting from footage manipulation, focusing on frame-level inspection. p. 7 This module targets audiovisual inconsistencies resulting from footage manipulation,
including splicing, compositing, or timing mismatches. It applies frame-level inspection and forensic media analysis to
detect irregular transitions, altered overlays, or temporal discontinuities. 3 Cyberspace Consistency Module. This module evaluates logical consistency within the game’s internal environment.Where the paper says it
Where the paper says it
Forensic Process Pipeline
The Tracer framework outlines a five-step forensic process pipeline to evaluate submissions The steps include (1) Evidence Acquisition, (2) Artefact Normalisation, (3) Event Attribution, (4) Analytical Review, and (5) Verdict Synthesis. The analytical review phase utilizes domain-specific heuristics to identify inconsistencies or manipulative artefacts. p. 7 (4) Analytical Review. Use domain-specific heuristics to identify inconsistencies or manipulative artefacts.Where the paper says it
Future Development Directions
The authors plan to mature the framework by incorporating more formalised criteria and validated use cases Future work intends to develop audiovisual forensic automation to detect anomalies in gameplay footage. They also intend to harvest gameplay logs for input or memory trace collectors, which could serve as input for automated anomaly detection models. p. 8 , input or memory trace
collector) is developed and adopted by ludic metagaming communities. The logs could then serve as input for automated
anomaly detection models, drawing on methods from bot detection. The logs could then serve as input for automated
anomaly detection models, drawing on methods from bot detection. While data sparsity in this context may hinder full
automation, assistive AI or machine learning based tools would still substantially improve evaluation efficiency.Where the paper says it
Where the paper says it
Known Incidents of Forged Ludic Metagame Runs
The appendix provides five exemplary cases illustrating common manipulation techniques such as Badabun’s Plagiarized Super Mario Run Schmooey and the Guitar Hero Scandal EpicSeastar’s Reconstructed Jump King Speedrun Queen Pwnzalot and Staged Live Streams of Blindfolded Monster Hunter Runs And Dream’s Altered PRNG in Minecraft Speedrun. These cases underscore the need for systematic verification mechanisms to respond to such manipulations with greater consistency and discipline. p. 9 The subsequent incidents underscore the need for more
systematic and transparent verification mechanisms. By examining the following five exemplary cases, we can better
understand common manipulation techniques and how they were detected.Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Visual artifact detection based on Media Continuity Module can be implemented to detect
abrupt scene transitions, jittering HUD elements, or tonal inconsistencies
in gameplay footage using frame-by-frame inspection. -
Physical Coherence Module can be enhanced to check for
Implausible input sequences, such as timing below human reaction thresholds or exceeding hardware limit
by cross-referencing handcam footage with in-game outcomes and hardware constraints like key rollover limits. -
Cyberspace Consistency Module can be automated to perform
Probabilistic Inconsistencies
checks by reverse-analyzing PRNG logs for games with deterministic mechanics, such as checking ifdrop rates were highly unlikely
compared to known internal probabilities. -
The system can integrate evidence acquisition and artefact normalization by extracting
frame-level input timestamps, and quantify game-specific metrics such as barter count or movement paths
from raw evidence to create structured representations for analysis. -
Event attribution can be automated to map observed events into forensic domains—physical, HCI, or cyberspace—preparing the data for domain-specific heuristic application during analytical review.
Abstract
Speedrun, a practice of completing a game as quickly as possible, has fostered vibrant communities driven by creativity, competition, and mastery of game mechanics and motor skills. However, this contest also attracts malicious actors as financial incentives come into play. As media and software manipulation techniques advance - such as spliced footage, modified game software and live stream with staged setups - forged speedruns have become increasingly difficult to detect. Volunteer-driven communities invest significant effort to verify submissions, yet the process remains slow, inconsistent, and reliant on informal expertise. In high-profile cases, fraudulent runs have gone undetected for years, allowing perpetrators to gain fame and financial benefits through monetised viewership, sponsorships, donations, and community bounties. To address this gap, we propose Tracer, Tamper Recognition via Analysis of Continuity and Events in game Runs, a modular framework for identifying artefacts of manipulation in speedrun submissions. Tracer provides structured guidelines across audiovisual, physical, and cyberspace dimensions, systematically documenting dispersed in-game knowledge and previously reported fraudulent cases to enhance verification efficiency.
Related papers
- EmoPhone: A Multi-Wave Dataset for In-the-Wild Mobile and Wearable Affect Sensing
- Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects
- Shielded Trajectory Sampling for Personalized Relational Safety in Conversational AI
- From Tasks to Turns: Measuring Human Labor Contributions in Human-Agent Joint Production
- Reconstruction and Reflection of Positive Experiences through Resurfacing Laughter-indexed Everyday Moments
- LLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender Systems