CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography
summary
The gist
Accurate delineation of anatomical structures in volumetric Computed Tomography (CT) scans is crucial for diagnosis and treatment planning…
In short
CADS creates a large-scale, standardized dataset and model for segmenting 167 anatomical structures across whole-body CT scans. It integrates data from diverse sources to build a robust AI model that achieves high accuracy in medical imaging, improving performance significantly over existing methods.
Key concepts
- CADS Dataset
- This is a massive collection of 22,022 CT volumes with complete labels for 167 different anatomical structures. It combines data from many different hospitals and sources to create a comprehensive resource for training AI models.
- CADS-model
- This is the fully automated segmentation model suite trained on the CADS dataset. It uses a 3D U-Net architecture and is designed to segment all 167 target structures consistently across various anatomical regions, like the heart or bones.
- Multi-strategy Label Optimization
- This process involves training several complementary models ('flavors') on different data subsets. The best model for each structure is then selected based on performance metrics, ensuring that the final dataset has high-quality labels for all structures.
- Performance-driven Flavor Selection
- When creating the final CADS dataset, each anatomical structure is evaluated using Dice Similarity Coefficient and Hausdorff distance. The label from the flavor that performs best for that specific structure is chosen as the definitive label.
Terminology used across episodes
This episode discusses
- CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography · Paper Radio
- VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imaging
- Medical Vision Generalist: Unifying Medical Imaging Tasks in Context
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Towards Unifying Anatomy Segmentation: Automated Generation of a Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelines
- Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomography
- Vision Foundation Models for Computed Tomography
- STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-training
- Computer Aided Detection for Pulmonary Embolism Challenge (CAD-PE)
- Automated Thoracolumbar Stump Rib Detection and Analysis in a Large CT Cohort
- nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentation
- Data-Centric Foundation Models in Computational Healthcare: A Survey
- Rethinking Abdominal Organ Segmentation (RAOS) in the clinical scenario: A robustness evaluation benchmark with challenging cases
- vesselFM: A Foundation Model for Universal 3D Blood Vessel Segmentation
The paper
CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography · Read on arXiv
Department of Quantitative Biomedicine University of Zurich · ETH AI Center ETH Zurich · Department of Radiation Oncology University Hospital and University of Zurich · Faculty of Medicine University of Zurich · School of Computation Information and Technology Technical University of Munich · Department of Diagnostic and Interventional Neuroradiology School of Medicine and Health Technical University of Munich Departmental Imaging Institute in Artificial Intelligence in Medicine TUM School of Medicine and Health Institute for Radiation Medicine Helmholtz Zentrum München Departmental Imaging Institute in Artificial Intelligence in Medicine Klinikum rechts der Isar TUM School of Medicine and Health German Consortium for Translational Cancer Research Partner Site Munich University Hospital Essen Institute for Interventional and Diagnostic Radiology Pediatric Radiology and Neuroradiology University Medical Center Rostock Medical University of Vienna Department of Biomedical Imaging and Image-guided Therapy Medical University of Vienna Department of Radiology University Hospital Basel Departmental Imaging Institute in Artificial Intelligence in Medicine Essen Institute for Diagnostic and Interventional Radiology Pediatric Radiology and Neuroradiology University Medical Center Rostock Departmental Imaging Institute in Artificial Intelligence in Medicine Essen
Volumetric computed tomography (CT) segmentation supports quantitative image analysis, but most AI-based methods remain organ-specific, with fragmented models, inconsistent label definitions, and heterogeneous training and evaluation protocols. Here we present CADS, a unified data-model framework for scalable and generalizable whole-body CT segmentation. We construct a SNOMED-CT-referenced anatomical label space harmonizing heterogeneous cohorts from over 100 imaging centers, yielding complete annotations of 167 structures across 22,022 CT volumes and markedly expanding anatomical coverage and scale beyond existing resources. To complete labels on sparsely annotated CTs, we combine self-training with shape-informed quality control based on neural implicit functions, curating high-quality pseudo-labels. Trained on this resource, CADS shows robust whole-body segmentation across distribution shifts and improved performance relative to state-of-the-art approaches across 18 public datasets. We further validate it in an independent, expert-reviewed real-world oncology cohort of 2,864 CTs. The curated dataset, pretrained models, and user-friendly software together provide an accessible, reproducible foundation for large-scale anatomical segmentation and computational anatomy research.
DOI: 10.1038/s41467-026-78732-1
Transcript
Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.
Rosa: We're looking at the paper: "CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography".
Dev: Here's the gist of the paper. Accurate delineation of anatomical structures in volumetric Computed Tomography (CT) scans is crucial for diagnosis and treatment planning, yet current approaches often suffer from a fragmented landscape of incompatible models with varying performance protocols.
Rosa: Foundational segmentation models designed to process multiple organs offer a holistic view, but robust clinical deployment requires comprehensive training data that addresses data heterogeneity and anatomical coverage—areas where existing whole-body approaches are deficient.
Dev: This work introduces CADS (Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography), an open-source framework prioritizing the systematic integration, standardization, and labeling of heterogeneous, cross-institutional, and cross-vendor CT data sources for whole-body CT segmentation.
Rosa: The core contribution is a large-scale dataset comprising 22,022 CT volumes with complete annotations for 167 anatomical structures.
Title and authors: Rosa: So we're looking at this paper today called "CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography". It sounds like a big deal for getting AI to actually understand the whole body from CT scans.
Dev: Yeah, it's about building a dataset and a segmentation model that can handle all those structures across the entire body. The authors are Xu, Amiranashvili, Navarro, Fritsak, Hamamci, Shitmann, Wittmann, Christman-Christ3, de la Rosa1, Deseoe1, Graf8.
Rosa: What this means for us is that we're finally looking at a way to get comprehensive anatomical delineation instead of just looking at one organ in isolation. It moves us toward a holistic view.
Dev: Exactly. The authors are aiming to advance robust AI solutions in radiology and make comprehensive anatomical analysis accessible to clinicians and researchers alike, as mentioned on page two > <ref:2507.22953#pg1>
The paper's summary: Rosa: So what's the actual substance of this CADS paper? Basically, they're presenting an open-source framework. It’s not just a single model; it’s a whole system for organizing and labeling data from all over.
Dev: They are focusing on integrating heterogeneous, cross-institutional, and cross-vendor CT data sources systematically. The core contribution is this large dataset they put together.
Rosa: That dataset has twenty-two thousand twenty-two CT volumes with complete annotations for one hundred sixty-seven different anatomical structures <ref:2507.22953#pg3,22,022 CT volumes with>. That’s a huge scale compared to what’s out there right now.
Dev: It is eighteen times more scans than existing collections and sixty percent more distinct anatomical targets, which is a significant increase in coverage. They are using pseudo-labeling grounded in self-training through iterative model refinement, shape-guided qualification of those labels >
The paper's improvements: Rosa: The authors talk about how they built this system. It’s a multi-stage pipeline to go from raw data to the final segmentation model.
Dev: They started with training initial region-specific models on nine anatomical regions, which cover all those one hundred sixty-seven target structures, and then generating pseudo-labels across all twenty-two thousand twenty-two volumes > <ref:2507.22953#pg3>
Rosa: Then they have this quality control step where they use neural implicit functions and shape priors to filter out the unreliable pseudo-labels. That’s a smart way to clean up the noise.
Dev: And then they use a multi-strategy label optimization process. They combine three complementary models, or flavors, each trained with different data characteristics, to create the final CADS dataset >
Rosa: Finally, they train the main CADS model using customized class balancing strategies to make sure every structure gets attention. It’s a very detailed approach to building this comprehensive system.
Conclusion: Dev: So putting it all together, the paper presents the CADS framework, which includes both the dataset and a robust segmentation model suite trained on it. The whole point is accessibility and scale for whole-body analysis.
Rosa: It really shows how much more data and better organization we need to move beyond looking at just one organ at a time in CT scans. The performance metrics are pretty impressive across the board, with an overall Dice score of eighty-five point eight seven percent across all one hundred sixty-seven structures >
Dev: Especially for things like the heart, they got average Dice improvements of nine point two percent for myocardium and seven point five percent for pulmonary artery structures >
Rosa: It’s a lot of data diversity—spanning forty sources in sixteen countries—which means the model should generalize pretty well to different imaging protocols and patient groups.
Dev: But we have to remember what they admit about their process. They mention that closed-source models and deliverables hinder reproducibility, which is a real challenge for adoption >
Rosa: And they also pointed out accessibility barriers, like the absence of user-friendly tools, which can stop healthcare practitioners from actually integrating these solutions into clinical workflows >
Dev: So while the results on performance are strong across various regions—like the Liver getting a mean Dice score of ninety-six point nine four plus two point zero zero—the real hurdle is making sure everyone can use this tool reliably in a real hospital setting >
More episodes
- Daily Summary for 2026-11-19
- 2111.07910-Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction
- 2203.02149-HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
- 2205.10102-Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging
- 2311.10959-Structure-Aware Sparse-View X-ray 3D Reconstruction
- 2403.04116-Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
- 2410.02572-Combining Pre- and Post-Demosaicking Noise Removal for RAW Video
- 2604.17453-Learned Nonlocal Feature Matching and Filtering for RAW Image Denoising
- 2603.20387-End-to-End Multi-Task Learning for Adjustable Joint Noise Reduction and Hearing Loss Compensation
- 2507.20825-Chirp-Permuted AFDM: A Versatile and Multifunctional Waveform for 6G