PathoGaze1.0: An AI-Ready Navigation, Eye-Tracking, and Decision Dataset in Pathology

summary

The gist

Interpretation of giga-pixel whole-slide images (WSIs) is an important but difficult task for pathologists Their diagnostic accuracy is estimated to average around 70% The field lacks adequate…

In short

PathoGaze1.0 is a behavioral dataset capturing how pathologists interact with whole-slide images during cancer diagnosis using eye-tracking and mouse data. It collected 18.69 hours of diverse interaction from 19 experts interpreting 397 slides, revealing distinct viewing strategies and showing that tumor size strongly influences diagnostic accuracy.

Key concepts

Whole-Slide Images (WSIs)
These are high-resolution digital scans of entire tissue samples used by pathologists for diagnosis. The paper focuses on how experts navigate these complex images to make a diagnosis, highlighting the difficulty of this task.
Eye-Tracking and Mouse Interaction Data
This data captures the dynamic visual search patterns, including where a pathologist looks (gaze) and how they use their mouse to interact with the software. This behavioral data helps researchers understand the decision-making process during diagnosis.
Ecological Validity (PTAH)
Data collection occurred in an application-grounded testbed called PTAH, which simulates real diagnostic workflows. This method ensures the collected behavior reflects actual clinical practice rather than artificial laboratory settings.
Diagnostic Accuracy Metrics
The study measured how accurate pathologists were at diagnosing cancer based on their viewing behaviors. A key finding was that tumor size was a major factor, with accuracy reaching 91.0% for macrometastasis slides.

Terminology used across episodes

This episode discusses

The paper

PathoGaze1.0: An AI-Ready Navigation, Eye-Tracking, and Decision Dataset in Pathology · Read on arXiv

Veronica Thai, Rui Li, Meng Ling, Shuning Jiang, Jeremy Wolfe, Raghu Machiraju, Yan Hu, Zaibo Li, Anil Parwani, ¢Jian Chen

The Ohio State University Computer Science and Engineering Department of Computer Science and Engineering The Ohio State University Medical Center Department of Pathology The Harvard Medical School Departments of Ophthalmology and Radiology Brigham and Women’s Hospital

Performing cancer diagnosis on giga-pixel whole-slide images (WSIs) is an important but difficult visual search task. The large giga-pixel image size forces pathologists to navigate by zooming and panning to search tissue for malignancy. Diagnostic accuracy averages around 70%, and adding a second pathologist does not substantially improve consistencies between diagnoses. There is a lack of publicly available behavioral data to explain these diagnostic errors and inconsistencies. To fill this gap, we curated PathoGaze1.0, a comprehensive behavioral dataset capturing high-fidelity clinical diagnostic workflows across 11 different pathologist participants over two experiments 12-months apart (8 overlapping pathologists across both experiments), as they interpreted 397 WSIs from CAMELYON16, a set of publicly available breast cancer lymph node WSIs. The dataset comprises 18.69 hours of eye-tracking (171,909 fixations), and navigational scanning data along with 1,140 diagnostic decisions, all collected using a newly-developed testbed PTAH. The testbed supports interaction techniques found in clinical tools and collects viewport, mouse actions, and diagnostic decisions, enabling cross-links between WSI image stimulus, gaze, navigation behaviors, and diagnostic decisions. We share preregistered experimental materials, the datasets, and processing methods on the Open Science Framework (OSF).

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "PathoGaze1.0: An AI-Ready Navigation, Eye-Tracking, and Decision Dataset in Pathology".

Paper summary: Tom: So wrapping up the PathoGaze1 point 0 paper, the authors are giving us this comprehensive behavioral dataset of eye-tracking and decision-making data from nineteen pathologists working on whole slide images > <ref:2510.24653#pg1>

Jane: The title itself, "PathoGaze1 point 0: An AI-Ready Navigation, Eye-Tracking, and Decision Dataset in Pathology," suggests they're aiming to make this behavior data usable for building actual AI systems that can navigate and diagnose cancer slides > <ref:2510.24653#pg1>

Lu: It’s important because it directly addresses the lack of behavioral data in this field that was holding back diagnostic accuracy estimates around seventy percent >

Meng: For production, the implication is that if an AI system can learn from these viewing strategies, it might be able to correct those inconsistencies where different human pathologists make different choices >

Lalam: The paper lays out how they structured the data—all the files and metadata are available according to FAIR principles, making it accessible for long-term analysis by other researchers >

Tom: It’s a big step because they didn't just look at the final diagnosis; they captured the entire journey of visual search, from loading the image to making that final decision >

Jane: So what this means simply is that we can finally start studying *how* humans look at these massive images, which is something we completely lacked before >

Conclusion: Tom: So we’ve seen how PathoGaze1 point zero is tracking what pathologists do when they look at whole slide images and making decisions, and now we’re at the end of this segment to wrap up what this paper actually means for us <ref:2510.24653#pg3>.

Jane: This whole dataset is built around capturing the actual viewing behavior—the eye movements, the mouse clicks, and those diagnostic decisions—from nineteen different pathologists working on cancer diagnoses. It gives us a real look into that process.

Lu: The authors are basically saying they’ve created a comprehensive behavioral dataset to finally explain why pathologists sometimes get inconsistent results when looking at these massive whole slide images.

Meng: So what does that inconsistency actually mean for deploying an AI? Can we use this data to make sure the AI follows the right path, or is it just another way to train a model on human mistakes?

Lalam: It means we have something concrete to train on—not just the final diagnosis—so if an AI can learn these viewing strategies, it might be able to navigate those tricky areas better.

Tom: That’s the core idea, right? They didn't just give us pictures of slides and answers; they gave us eighteen point six nine hours of actual eye tracking and interaction data.

Jane: Right, it’s about making the process transparent so we can finally measure how much variability there is in how people diagnose these things.

Lu: The key finding they highlight is that tumor size itself is a huge factor influencing accuracy, with participants being ninety-one point zero percent accurate on slides with macrometastasis.

Meng: That's a big number, but I wonder if that accuracy holds up when we move from lab conditions to actual clinical environments where things are much more cluttered and the lighting is bad.

Lalam: The data is structured really well, following FAIR principles so other researchers can actually use it long-term. You have the data and the code available online at go osu edu pathogaze.

Tom: Exactly. It’s about accessibility for building better AI, not just for publishing a new paper in a journal that nobody reads.

Jane: So what we're looking at here is how to bridge the gap between knowing *what* they decided and understanding *how* they got there, which is super important for building reliable diagnostic tools.

More episodes

← Home