Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT

summary

The gist

Fully automated high-precision segmentation of retinal atrophy and ellipsoid zone thickness in OCT provides a reliable tool for real-world geographic atrophy monitoring The proposed pipeline uses…

In short

This research developed a fully automated pipeline using three specialized deep learning models to precisely segment retinal pigment epithelium loss and ellipsoid zone integrity in Optical Coherence Tomography (OCT) scans. The method achieved high accuracy, with Dice scores of 0.88 for RPE loss and 0.87 for EZ loss, providing a reliable tool for monitoring geographic atrophy in real-world clinical settings.

Key concepts

RPE Loss
This refers to the progressive damage or complete absence of the retinal pigment epithelium, which is a layer of cells situated beneath the photoreceptors. In this study, it was defined as the complete lack of the ellipsoid zone band or any downward displacement of deeper retinal layers.
Ellipsoid Zone (EZ) Integrity
The ellipsoid zone is a critical structure composed of photoreceptor segments that connect to Bruch's membrane. Segmenting this zone helps assess the structural health and integrity of the photoreceptors, which is a key biomarker for Geographic Atrophy (GA).
Semantic Segmentation Models
These are advanced AI models (like UNet++ and DenseNet-201) trained to automatically classify every pixel in an OCT image into specific categories, such as RPE loss or EZ boundaries. This allows the system to delineate complex structures with high precision.
Geographic Atrophy (GA)
GA is a form of Age-related Macular Degeneration characterized by progressive, patchy loss of retinal pigment epithelium and overlying photoreceptors. The study focuses on using automated segmentation to accurately measure this structural loss for monitoring disease progression.

Terminology used across episodes

This episode discusses

The paper

Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT · Read on arXiv

Wolf-Dieter Vogl, Hlynur Skulason, Oliver Leingang, Ursula Schmidt-Erfurth, Amir Sadeghipour, Ariadne Whitby

RetInSight GmbH · Laboratory of Opthalmic Image Analysis (OPTIMA) · Medical University of Vienna

Purpose: To develop and validate a fully automated deep learning method for segmenting retinal pigment epithelium (RPE) loss, ellipsoid zone (EZ) loss, and EZ thickness in geographic atrophy (GA) on optical coherence tomography (OCT). Methods: Three convolutional neural networks segment Bruch's membrane, the EZ boundaries, and RPE loss in Spectralis OCT volumes; EZ loss and thickness are derived from the EZ boundaries. The networks were developed on 298 volumes (GA, intermediate and neovascular age-related macular degeneration, healthy) and evaluated against double-graded expert annotations in an independent real-world set of 43 eyes with GA. Further analyses assessed inter-reader reliability (25 eyes), test-retest repeatability between screening and baseline visits of two phase 3 trials (68 eyes), and the effect of B-scan density (61 eyes). Results: Mean Dice similarity coefficients were 0.88 (95% confidence interval [CI], 0.84-0.90) for RPE loss and 0.87 (95% CI, 0.83-0.89) for EZ loss; the mean absolute EZ thickness error was 2.08 μ m. Agreement with an independent reader group was similar to inter-reader agreement. Test-retest intraclass correlation coefficients were 0.995 (RPE loss) and 0.988 (EZ loss). Lower B-scan densities had little effect on lesion area but markedly increased the error in measuring 3-month change. Conclusions: On real-world OCT, the fully automated method was accurate, with agreement comparable to human readers, and reliable, with high test-retest repeatability. Translational Relevance: Fully automated, reproducible quantification of RPE and photoreceptor loss on routine OCT could support standardized structural endpoints in GA clinical trials and objective assessment of GA in routine ophthalmic care.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT".

Jane: Here's the gist of the paper. Fully automated high-precision segmentation of retinal atrophy and ellipsoid zone thickness in OCT provides a reliable tool for real-world geographic atrophy monitoring The proposed pipeline uses three specialized semantic segmentation models to delineate RPE loss, EZ boundaries, and Bruch’s membrane Results demonstrated high segmentation accuracy (Dice RPE loss: 0.88, Dice EZ loss: 0.87) and a strong reproducibility score (ICC > 0.98).

Tom: Pruning redundant reasoning tokens Geographic atrophy secondary to age-related macular degeneration requires precise monitoring of relevant structural biomarkers to assess disease stage, progression, and treatment response High-precision automated segmentation of RPE loss and EZ atrophy represents the advanced ”dry” stage of AMD, characterized by progressive loss of retinal pigment epithelium (RPE), overlying photoreceptors (PRs), and the underlying choriocapillaris The method has been validated on an independent real-world dataset How the training signal is built The models were developed on a diverse dataset of 298 SD-OCT volumes representing the full phenotypic spectrum of AMD (GA:222, intermediate AMD: 40, neovascular AMD: 17, healthy: 19) and validated on an independent external dataset (n=43) Data selection was curated for maximum phenotypic variability, including a broad range of lesion sizes and edge cases challenging prior automated segmentation iterations Ground truth was established by four experienced graders according to a clinically validated protocol, defining RPE loss as the complete absence of the EZ band or downward displacement of the outer nuclear layer (ONL) and outer plexiform layer (OPL) Where the gains come from The framework utilizes three semantic segmentation models: 1.

Jane: BM segmentation model: Implemented using a 2D CNN UNet++ featuring an EfficientNet-B5 encoder to predict BM positions per individual A-scan at subpixel resolution 2.

Tom: EZ layer segmentation model: Utilizes a 2D U-Net architecture with a DenseNet-201 encoder to segment the EZ across three distinct anatomical regions 3.

Paper summary: Tom: So we're looking at this paper today: "Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT." Basically, they've built a system to automatically find and measure retinal pigment epithelium loss, ellipsoid zone loss, and thinning in geographic atrophy using optical coherence tomography.

Jane: That sounds really precise. So what’s the main idea behind this approach? What are they trying to achieve with this automated segmentation?

Tom: The thesis is that geographic atrophy in age-related macular degeneration needs very accurate monitoring of these structural markers to figure out how bad the disease is, how it's progressing, and if a treatment is working. So instead of someone manually looking at every scan, they propose a fully automated pipeline using three different semantic segmentation models to draw the lines for RPE loss and EZ boundaries and Bruch’s membrane.

Lu: I'm interested in how they structured those three models because that's where the real depth is, you know, how you handle all those different types of data input.

Meng: From a deployment standpoint, it sounds like a lot of complex architecture for what we want to be something that actually runs reliably on a clinic's hardware. What kind of complexity are we talking about here?

Lalam: This paper focuses on using three specific models: the BM segmentation model which uses a two dimensional convolutional neural network called a UNet plus with an EfficientNet B five encoder to predict Bruch’s membrane positions per individual scan at subpixel resolution.

Tom: Okay, so one of those models is focused on the Bruch’s membrane, using that UNet plus structure with the EfficientNet B five encoder to pinpoint its location on each scan very finely.

Jane: And then they have a second model for segmenting the EZ layer itself, which uses a two dimensional U-Net architecture with a DenseNet twenty one encoder to segment the EZ across three different anatomical regions.

Lu: That DenseNet twenty one architecture is interesting because it suggests a strong focus on capturing features in dense data, and they use it to delineate the EZ layer across those distinct anatomical areas.

Meng: Three models sounds like high computational load, which makes me wonder about the inference time for real-time clinical use. How fast is this whole process supposed to run?

Paper summary: Tom: They’ve actually developed a third model for RPE loss segmentation, and that one uses a three dimensional to two dimensional Feature Projection Network called an FPN to transform full three dimensional OCT volumes into a two dimensional en face map.

Jane: So, they are tackling the RPE loss by projecting the whole three dimension volume down into a flat image where they can segment it. That sounds like a big step in handling that volumetric information.

Lalam: They trained these models on a diverse dataset of two hundred ninety eight SD OCT volumes representing the full spectrum of age related macular degeneration, including geographic atrophy, intermediate am amd, neovascular am amd, and healthy scans.

Tom: A really broad phenotypic range for training is important. So they validated this entire framework using an independent external dataset of forty three volumes to make sure it wasn't just overfitting to the initial training pool.

Jane: And how did they define what counts as RPE loss in their ground truth? That’s a crucial point because 'loss' can be defined in different ways depending on who you ask.

Tom: They defined RPE loss as the complete absence of the EZ band or a downward displacement, or subsidence, of the outer nuclear layer and outer plexiform layer.

Lu: I like that definition because it ties the structural loss directly to observable changes in those specific retinal layers. It’s concrete.

Meng: But what about clinical variability? If you're using this in a real clinic setting, how does it handle different lesion sizes or scan densities? That’s where models often fail when they move from research to reality.

Tom: They did test for robustness by stratifying their analysis by lesion size and looked at the relevance of OCT b scan density on measurement accuracy across standard B scan patterns like thirty one four, two three nine, and twelve two microns.

Jane: So they checked if the performance holds up when the lesion is very small or when there are gaps in the B scans between slices. What did those tests show about that?

Tom: For small lesions with a size less than zero point five square millimeter, metrics like disc score were strongly influenced by that size, but surface distance metrics like HD nine five and ASSD proved more robust to those variations.

Lu: That’s a key finding for representation learning because it tells us which features are truly stable across different scales in the image.

Paper summary: Meng: When you look at the performance numbers, what are the actual scores they report for RPE loss and EZ loss area measurements? I need to know if this is actually hitting targets.

Tom: They achieved a mean disc score of zero point eight eight for RPE loss and zero point eight seven for EZ loss. And their accuracy of those area measurements correlated very highly with the manual ground truth, with a pearson r of nine nine nine for RPE loss and nine nine six for EZ loss.

Jane: A correlation that high is impressive, especially when you factor in that inter reader reliability test they did on the area measurements using icc two one values around zero point nine eight five.

Lu: That inter reader reliability test is a good check because it means the system isn't just accurate against one set of eyes, but consistently reproducible across different people.

Meng: But there was still a slight systematic bias mentioned in the Deming regression analysis; they saw a marginal over segmentation of RPE loss area by zero point three millimeters and an under segmentation of EZ loss area by negative zero point three five millimeters. That’s something we have to consider when deploying it.

Tom: It’s a small offset, but it shows that even this high-precision tool isn't perfectly neutral; the prediction might be slightly too big or slightly too small depending on what you're measuring.

Jane: So, looking at the overall implications for someone who just watches this show, what does this automated segmentation actually change about how we monitor geographic atrophy in the real world?

Tom: It means that with a fully automated system like this pipeline—the one they described in "Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT"—we can get high precision for tracking structural loss without needing constant manual oversight.

Lu: The implication is that we could potentially alleviate the need for burdensome microperimetry by providing a direct translation of structural data into functional insights for routine clinical practice.

Meng: From a production view, if you can automate this, you reduce the human error rate significantly in the initial assessment stage, which is where most of our pipeline failures happen.

Jane: So it moves the focus from manual interpretation to automated measurement, and they claim that optimized EZ thickness assessments could help clinicians get functional insights for routine practice.

Tom: Exactly. They’ve created a reliable tool for real world geographic atrophy monitoring by using this fully automated deep learning segmentation framework in OCT images >

Conclusion: Tom: So we've been looking at this paper, "Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT." Basically, they've built a system to automatically find and measure retinal pigment epithelium loss, ellipsoid zone loss, and thinning in geographic atrophy using optical coherence tomography.

Jane: That sounds really precise. So what’s the main idea behind this approach? What are they trying to achieve with this automated segmentation?

Tom: The thesis is that geographic atrophy in age-related macular degeneration needs very accurate monitoring of these structural markers to figure out how bad the disease is, how it's progressing, and if a treatment is working. So instead of someone manually looking at every scan, they propose a fully automated pipeline using three different semantic segmentation models to draw the lines for RPE loss and EZ boundaries and Bruch’s membrane.

Lu: I'm interested in how they structured those three models because that's where the real depth is, you know, how you handle all those different types of data input.

Meng: From a deployment standpoint, it sounds like a lot of complex architecture for what we want to be something that actually runs reliably on a clinic's hardware. What kind of complexity are we talking about here?

Lalam: This paper focuses on using three specific models: the BM segmentation model which uses a two dimensional convolutional neural network called a UNet plus with an EfficientNet B five encoder to predict Bruch’s membrane positions per individual scan at subpixel resolution.

Jane: Okay, so one of those models is focused on the Bruch’s membrane, using that UNet plus structure with the EfficientNet B five encoder to pinpoint its location on each scan very finely.

Tom: And then they have a second model for segmenting the EZ layer itself, which uses a two dimensional U-Net architecture with a DenseNet twenty one encoder to segment the EZ across three different anatomical regions.

Lu: That DenseNet twenty one architecture is interesting because it suggests a strong focus on capturing features in dense data, and they use it to delineate the EZ layer across those distinct anatomical areas.

Meng: Three models sounds like high computational load, which makes me wonder about the inference time for real-time clinical use. How fast is this whole process supposed to run?

Tom: They’ve actually developed a third model for RPE loss segmentation, and that one uses a three dimensional to two dimensional Feature Projection Network called an FPN to transform full three dimensional OCT volumes into a two dimensional en face map.

Wrap-up: Jane: So, they are tackling the RPE loss by projecting the whole three dimension volume down into a flat image where they can segment it. That sounds like a big step in handling that volumetric information.

Lalam: They trained these models on a diverse dataset of two hundred ninety eight SD OCT volumes representing the full spectrum of age related macular degeneration, including geographic atrophy, intermediate am amd, neovascular am amd, and healthy scans.

Tom: A really broad phenotypic range for training is important. So they validated this entire framework using an independent external dataset of forty three volumes to make sure it wasn't just overfitting to the initial training pool.

Jane: And how did they define what counts as RPE loss in their ground truth? That’s a crucial point because 'loss' can be defined in different ways depending on who you ask.

Tom: They defined RPE loss as the complete absence of the EZ band or a downward displacement, or subsidence, of the outer nuclear layer and outer plexiform layer.

Lu: I like that definition because it ties the structural loss directly to observable changes in those specific retinal layers. It’s concrete.

Meng: But what about clinical variability? If you're using this in a real clinic setting, how does it handle different lesion sizes or scan densities? That’s where models often fail when they move from research to reality.

Tom: They did test for robustness by stratifying their analysis by lesion size and looked at the relevance of OCT b scan density on measurement accuracy across standard B scan patterns like thirty one four, two three nine, and twelve two microns.

Jane: So they checked if the performance holds up when the lesion is very small or when there are gaps in the B scans between slices. What did those tests show about that?

Tom: For small lesions with a size less than zero point five square millimeter, metrics like disc score were strongly influenced by that size, but surface distance metrics like HD nine five and ASSD proved more robust to those variations.

Lu: That’s a key finding for representation learning because it tells us which features are truly stable across different scales in the image.

Meng: When you look at the performance numbers, what are the actual scores they report for RPE loss and EZ loss area measurements? I need to know if this is actually hitting targets.

Wrap-up: Tom: They achieved a mean disc score of zero point eight eight for RPE loss and zero point eight seven for EZ loss. And their accuracy of those area measurements correlated very highly with the manual ground truth, with a pearson r of nine nine nine for RPE loss and nine nine six for EZ loss.

Jane: A correlation that high is impressive, especially when you factor in that inter reader reliability test they did on the area measurements using icc two one values around zero point nine eight five.

Lu: That inter reader reliability test is a good check because it means the system isn't just accurate against one set of eyes, but consistently reproducible across different people.

Meng: But there was still a slight systematic bias mentioned in the Deming regression analysis; they saw a marginal over segmentation of RPE loss area by zero point three millimeters and an under segmentation of EZ loss area by negative zero point three five millimeters. That’s something we have to consider when deploying it.

Tom: It’s a small offset, but it shows that even this high-precision tool isn't perfectly neutral; the prediction might be slightly too big or slightly too small depending on what you're measuring.

Jane: So, looking at the overall implications for someone who just watches this show, what does this automated segmentation actually change about how we monitor geographic atrophy in the real world?

Tom: It means that with a fully automated system like this pipeline—the one they described in "Fully Automated Deep Learning Segmentation of RPE Loss and Ellipsoid Zone Integrity in Geographic Atrophy on Real-World OCT"—we can get high precision for tracking structural loss without needing constant manual oversight.

Lu: The implication is that we could potentially alleviate the need for burdensome microperimetry by providing a direct translation of structural data into functional insights for routine clinical practice.

Meng: From a production view, if you can automate this, you reduce the human error rate significantly in the initial assessment stage, which is where most of our pipeline failures happen.

Jane: So it moves the focus from manual interpretation to automated measurement, and they claim that optimized EZ thickness assessments could help clinicians get functional insights for routine practice.

Tom: Exactly. They’ve created a reliable tool for real world geographic atrophy monitoring by using this fully automated deep learning segmentation framework in OCT images, but we have to keep an eye on those small systematic offsets they found in the area measurements.

More episodes

← Home