Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation: a feasibility study

summary

The gist

Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation…

In short

Researchers developed ChameleonNet, a framework using contrastive unpaired image translation to synthesize non-contrast CT images from contrast-enhanced scans. This synthesized data was then used to train a deep learning model (modified nnU-Net) to segment four heart chambers: LA, LV, RA, and RV. The study showed feasibility on real scans but noted volume errors in the LV and RV.

Key concepts

Contrastive Unpaired Translation (CUT)
This is an unsupervised image translation network designed to create synthetic non-contrast CT images from contrast-enhanced ones without needing paired data. It uses a specific loss function called decoupled contrastive learning to ensure the generated images retain important anatomical details while changing the contrast level.
nnU-Net
This is a modified deep learning model used for segmentation. It is an architecture known for its strong performance in medical image segmentation tasks. In this study, it was trained on the synthesized non-contrast images to accurately delineate the boundaries of the four heart chambers.
Decoupled Contrastive Learning Loss (DCE)
This specific loss function adjusts how the contrastive learning is calculated during image translation. By removing a term from the denominator, it addresses negative-positive coupling, which improves how quickly and effectively the generator learns to produce realistic target images.
Dice Similarity Coefficient (DSC)
The DSC is a metric used to evaluate segmentation performance. It measures how well the predicted boundaries of a heart chamber match the true boundaries in the ground truth data. A higher DSC indicates better agreement between what the model predicted and what is actually there.

Terminology used across episodes

This episode discusses

The paper

Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation: a feasibility study · Read on arXiv

Jing Wang, Tong Yu, Hao-En Lu, Zixue Zeng, Joseph K. Leader, Xin Meng, Jianbing Zhu, Jiantao Pu

Department of Radiology, University of Pittsburgh Department of Bioengineering, University of Pittsburgh Department of Ophthalmology

Purpose: To evaluate the feasibility and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation and deep learning-based segmentation. Approach: We developed ChameleonNet, a framework utilizing the Contrastive Unpaired Translation (CUT) network with decoupled contrastive learning (DCL) loss to synthesize non-contrast CT from contrast CT scans. Using annotations of four heart chambers (left atrium (LA), left ventricle (LV), right atrium (RA), and right ventricle (RV)) from contrast scans, we trained a Hausdorff distance loss-enhanced nnU-Net on synthesized non-contrast images. The translation model was trained with 35,538 contrast-enhanced and 37,197 non-contrast CT slices. The segmentation model was trained with 292 synthesized non-contrast scans. Performance was evaluated using Dice similarity coefficient (DSC) and 95th Hausdorff distance (HD95) on 36 synthesized non-contrast scans, and volume agreement on 36 real non-contrast CT scans was assessed using Pearson correlation, mean absolute percentage error (MAPE), and mean percentage error (MPE). Results: The segmentation model achieved DSC of 0.94 (0.01), 0.91 (0.04), 0.92 (0.03), 0.93 (0.02), and HD95 of 3.63 (1.49), 5.74 (4.08), 5.18 (1.77), 5.51 (3.21) mm on synthesized non-contrast images for LA, LV, RA, and RV, respectively. On real non-contrast CT scans, Pearson correlations were 0.93, 0.82, 0.87, and 0.89 (all p<0.001), with MAPE ranging from 9.22% to 20.79%, and MPE ranging from-12.52% to 4.67%. Conclusions: ChameleonNet demonstrated feasibility for heart chamber segmentation from non-contrast CT without manual non-contrast annotations. However, volume errors, particularly for LV and RV, indicate that further refinement and validation are needed before clinical use.

DOI: 10.1117/1.JMI.13.5.054004

Transcript

Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.

Rosa: I'm Rosa.

Dev: And I'm Dev, here with Taro.

Rosa: We're looking at the paper: "Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation".

Dev: Here's the gist of the paper. Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation: a feasibility study is a feasibility study to evaluate and demonstrate how to segment heart chambers from non-contrast CT scans using contrastive unpaired image translation and deep learning-based segmentation The segmentation model achieved DSC of 0.94 (±0.01), 0.91 (±0.04), 0.92 (±0.03), and 0.93 (±0.02) on synthesized non-contrast images for LA, LV, RA, and RV respectively However, volume errors, particularly for LV and RV, indicate that further refinement and validation are needed before clinical use.

Rosa: Framework Development The framework developed is called ChameleonNet, which utilizes a two-stage approach combining contrastive unpaired image translation with deep learning-based segmentation The first stage involves an unsupervised image translation network trained to generate synthesized noncontrast CT images from contrast-enhanced CT scans while maintaining anatomical details This translation network employs the Contrastive Unpaired Translation (CUT) network with a decoupled contrastive learning (DCL) loss to synthesize noncontrast CT from contrast CT scans The segmentation stage then uses a modified nnU-Net model trained on the synthesized non-contrast images to segment four heart chambers: the left atrium (LA), left ventricle (LV), right atrium (RA), and right ventricle (RV).

Dev: Training Signal Construction The image translation stage utilizes a patch-wise contrastive loss, specifically the decoupled contrastive learning loss (DCE) which is introduced by removing the positive pair term from the denominator of InfoNCE This adjustment leads to the NPC multiplier being equal to 1 when training with lDCE The full loss for the image translation model is formulated as a combination of adversarial loss and the decoupled contrastive learning losses.

Rosa: In the segmentation stage, the modified nnU-Net incorporates a Hausdorff distance loss term alongside cross-entropy loss and Dice loss to minimize prediction errors.

Paper summary: Rosa: To wrap up this paper, "Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation: a feasibility study", the authors are essentially showing that you can use synthesized data to transfer annotations to train a segmentation model on non contrast CT scans >

Dev: The main point they are making is that even though the results show high Dice scores on synthetic images, the volume errors for chambers like the left ventricle and right ventricle signal that we still have work to do before this can be used clinically >

Taro: So, it's a feasible way to estimate cardiac chamber volumes from non contrast CT scans, but we need to address those chamber specific volume errors before you can rely on it for patient diagnosis >

Rosa: That's the title of the paper itself. It sets up both a promise and a challenge, showing that while the technique works on synthetic data, the real world has its own complexities >

Dev: The implications are that this framework offers a reliable method with potential applications in the prognosis and diagnosis of cardiovascular diseases because it lets us estimate volumes where manual annotation is too difficult >

Taro: It opens up possibilities for screening tools that can work with cheaper, more accessible non contrast CT data, which is a big deal since contrast scans aren't always an option >

Rosa: That’s the big picture. It's a reliable path forward in cardiovascular imaging when you can't rely on manual labeling to get the training data you need >

Conclusion: Rosa: So, we've looked at how they tried to map out heart chambers using noncontrast CT scans without having those manual outlines, and this paper is all about that promise versus the real challenges they found >

Dev: Right, it's about taking contrast CT data and turning it into synthetic noncontrast images to train a segmentation model on new data. They called it ChameleonNet >

Taro: The core idea is using an image translation network to synthesize those missing images while keeping all the anatomy intact so the segmentation model gets good training examples >

Rosa: And they achieved decent Dice scores on those synthetic images for things like the left atrium, left ventricle, right atrium, and right ventricle >

Dev: But here's where it gets tricky: they saw volume errors showing up particularly for the left ventricle and the right ventricle >

Taro: That means even though it works well on computer-generated pictures, when they test it on real noncontrast scans, those volume errors mean you can't just trust the numbers yet >

Rosa: So, what does this whole study really suggest about using this approach for actual patient care? >

Dev: It suggests this method is a feasible way to get started with estimating cardiac chamber volumes from noncontrast CT scans without needing every single manual label upfront >

Taro: It's a solid framework that can help in the prognosis and diagnosis of heart conditions because it lets you get those volumes where getting them manually is just too much work >

Rosa: But we have to remember the caveat they pointed out about the real data, right? >

More episodes

← Home