An XAI Approach to Deep Learning Models in the Detection of DCIS

summary

The gist

Deep Learning models have been employed over the past decade to improve the detection of conditions relative to the human body and in relation to breast cancer particularly <ref:2106.14186#pg2>.

In short

The study investigated methods to interpret a Convolutional Neural Network (CNN) model for detecting Ductal Carcinoma In Situ (DCIS) in mammograms. Researchers compared five Explainable AI (XAI) techniques, finding Deep Taylor Decomposition and LRP-Epsilon performed best. This research aims to give clinicians confidence by revealing how the model makes its classifications at the neuron level.

Key concepts

Back-propagation
This is a method used to train neural networks by adjusting the model's internal parameters based on errors. In this study, it was adapted to uncover how a selected CNN classifies a mammogram by tracing the influence back through its layers, revealing which neurons are most important for the final decision.
Deep Taylor Decomposition
This technique is used to approximate the relevance propagation function by breaking down complex functions into their partial derivatives. It helps researchers understand which specific neurons in a deep learning model contribute most significantly to classifying an image, particularly useful for images like mammograms.
XAI Techniques (e.g., LRP-Epsilon)
These are methods designed to explain the decisions made by complex AI models. They generate visualizations or maps that highlight which parts of the input data (like specific pixels in a mammogram) were most influential in the model's output, helping clinicians trust the diagnostic predictions.
ResNet-50 Architecture
This is a specific type of deep neural network architecture used in this research. ResNet-50 is known for its ability to learn complex features from images, and combining it with interpretation methods like Deep Taylor Decomposition provides a strong framework for analyzing how the model processes mammogram data.

Terminology used across episodes

This episode discusses

The paper

An XAI Approach to Deep Learning Models in the Detection of DCIS · Read on arXiv

Michele La Ferla, Matthew Montebello, Dylan Seychell

University of Malta

The results showed that XAI could indeed be used as a proof of concept to begin discussions on the implementation of assistive AI systems within the clinical community.

DOI: 10.1007/978-3-031-34171-7_33

Transcript

Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.

Rosa: We're looking at the paper: "An XAI Approach to Deep Learning Models in the Detection of DCIS".

Dev: Here's the gist of the paper. Deep Learning models have been employed over the past decade to improve the detection of conditions relative to the human body and in relation to breast cancer particularly <ref:2106.14186#pg2>.

Rosa: Our contribution attempts to interpret the early detection of breast cancer while enhancing clinicians’ confidence in such techniques through the use of eXplainable AI <ref:2106.14186#pg6>.

Dev: Research Focus and Methodology The study researched the best way to back-propagate a selected CNN model, previously developed in 2017; and adapted in 2019 <ref:2106.14186#pg3>.

Rosa: The methodology proved that it is possible to uncover the intricacies involved within a model; at neuron level, in converging towards the classification of a mammogram <ref:2106.14186#pg3>.

Title and authors: Rosa: Okay, so before we get into what they did, let's just nail down who wrote this. The paper is An XAI Approach to Deep Learning Models in the Detection of DCIS, and it’s written by Michele La Ferla, Matthew Montebello, and Dylan Seychell from the University of Malta.

Dev: Yeah, so it’s a team effort from researchers at that university focusing on this interpretability issue. It sets up a framework for how we can look inside these complex models to see the reasoning behind their output.

Taro: I wonder what their specific background is in the clinical side versus the deep learning side, because that usually dictates how useful the interpretation ends up being in a real setting.

Rosa: Well, they’re researchers tackling this from both sides—the clinical need for trust and the technical challenge of back-propagation—which should give them a solid grounding for what they are proposing.

Dev: It’s about bridging that gap between the complex math running on a computer and the practical decisions made by a radiologist looking at an image. That's the core goal of this work, connecting their technical approach to real medical practice.

The paper's summary: Rosa: So, what they actually did is test five different back-propagation methods on a CNN model that had been developed in two thousand seventeen and then updated in two thousand nineteen <ref:2106.14186#pg1>. They were trying to see which method was the best for uncovering the inner workings of the model at a neuron level when classifying a mammogram.

Dev: And they found that two techniques, Deep Taylor Decomposition and LRP-Epsilon, gave them the best results across their tests on a subset of twenty mammograms from their CBIS-DDSM dataset <ref:2106.14186#pg2>.

Taro: So they're comparing different mathematical tools for explaining what the model is doing when it looks at an actual mammogram image. That’s a very concrete comparison to make, moving away from just saying "the model is good."

Rosa: Right, and they noted that Deep Taylor Decomposition often performed better than the other three methods they tested, although LRP-Epsilon showed some better results in a couple of specific cases.

Dev: They also mentioned that this was done using the CBIS-DDSM dataset, which is an important detail because it’s a scanned film mammographic dataset that’s been annotated by expert radiologists and used widely in the deep learning community.

The paper's improvements: Rosa: Now, moving to what they suggest as improvements, they point out some real feedback from the specialists they interviewed. They noted that while this model approach is theoretically sound, the dataset itself could be better.

Dev: And that’s a big one because it means the quality of the input data matters a ton for how good any AI interpretation will actually be in practice, right?

Taro: I think they also flagged something specific about that dataset—they said it only displays a one-sided full-size mammogram for each case, which might limit what kind of information is available to the model.

Rosa: And then they suggested a combination: using a ResNet fifty architecture model alongside the Deep Taylor Decomposition method as a theoretically strong pairing for building deep learning models and applying backpropagation to them.

Dev: So the improvement isn't just one trick; it’s about combining a specific neural network structure with that specific mathematical decomposition technique to get this better interpretation. That combination seems like the most robust theoretical path they found.

Conclusion: Rosa: To wrap things up, these findings show that knowing how a model classified different mammograms—whether it's benign, malignant, or no signs of a tumour—is genuinely useful for radiologists who are trying to diagnose breast cancer.

Dev: They also pointed out that while this approach is promising, they need to improve the dataset because they felt the current one isn't as good as it could be for fully evaluating this XAI model.

Taro: And from my perspective, what their suggestion about choosing particular mammograms from the dataset and running the XAI model against them is a good practical next step to test its real-world utility before moving further.

Rosa: So, in short, they’ve shown that using techniques like Deep Taylor Decomposition on CNNs can reveal which neurons are important for classification, but they need better data and more specific testing scenarios to really make this tool reliable for clinical use.

Dev: It’s a solid piece of work because it takes the abstract idea of model interpretation and applies concrete mathematical methods to a high-stakes medical imaging task.

More episodes

← Home