Click, Predict, Trust: Clinician-Guided and Clinician-Evaluated AI Segmentation for Lung Cancer CT-Based Prognosis within the Knowledge-to-Action Framework
summary
The gist
Lung cancer is the leading cause of cancer death, with CT central to screening, prognosis, and treatment This study shows that VNet, integrated with SSL, can deliver accurate, reproducible…
In short
This study developed a clinician-in-the-loop pipeline using VNet and Semi-Supervised Learning (SSL) to improve CT-based lung cancer prognosis. VNet segmentation showed the best geometric accuracy and radiomics stability. The research proves that integrated evaluation frameworks, combining AI performance metrics with physician feedback, are crucial for achieving clinical trust and successful AI adoption in oncology.
Key concepts
- Knowledge-to-Action (KTA) Framework
- A structured approach used to guide the development of a clinician-in-the-loop pipeline. It ensures that research findings are translated into actionable steps for clinicians, focusing on improving reproducibility, prediction accuracy, and building clinical trust in AI tools.
- VNet (Vision Network)
- A deep learning model tested in this study that performed the best among five models. It achieved superior geometric accuracy and strong radiomics stability when segmenting lung cancer tumors from CT images, making it the most robust model for this application.
- Semi-Supervised Learning (SSL)
- A training framework used to improve model performance by combining labeled and unlabeled data. In this study, SSL consistently outperformed supervised learning because it provided more stable and reliable predictive performance during independent testing.
Terminology used across episodes
This episode discusses
- Click, Predict, Trust: Clinician-Guided and Clinician-Evaluated AI Segmentation for Lung Cancer CT-Based Prognosis within the Knowledge-to-Action Framework · Paper Radio
- Robust Semi-Supervised CT Radiomics for Lung Cancer Prognosis: Cost-Effective Learning with Limited Labels and SHAP Interpretation
- AllMetrics: A Unified Python Library for Standardized Metric Evaluation and Robust Data Validation in Machine Learning
The paper
Click, Predict, Trust: Clinician-Guided and Clinician-Evaluated AI Segmentation for Lung Cancer CT-Based Prognosis within the Knowledge-to-Action Framework · Read on arXiv
Mohammad R. Salmanpour, Sonya Falahati, Amir Hossein Pouria, Amin Mousavi, Somayeh Sadat Mehrnia, Morteza Alizadeh, Arman Gorji, Zeinab Farsangi, Alireza Safarian, Mehdi Maghsudi
Department of Basic and Translational Research, BC Cancer Research Institute, Vancouver, BC, Canada · Department of Radiology, University of British Columbia, Vancouver, BC, Canada · Technological Virtual Collaboration (TECVICO Corp.) · Amirkabir University of Technology · Abhar Branch Islamic Azad University Department of Computer Engineering Abhar · Department of Integrative Oncology Breast Cancer Research Center Motamed Cancer Institute ACECR Tehran · Department of Mathematics University of Isfahan Isfahan Iran · NAIRG Department of Neuroscience Hamadan University Medical Sciences Hamadan Iran · Rajaie Cardiovascular Medical and Research Center Iran University of Medical Science Tehran Iran · Department of Nuclear Medicine University Hospital Paracelsus Medical University Salzburg Austria · BC Cancer Vancouver Center Vancouver BC Canada
Lung cancer remains the leading cause of cancer mortality, with CT imaging central to screening, prognosis, and treatment. Manual segmentation is variable and time-intensive, while deep learning (DL) offers automation but faces barriers to clinical adoption. Guided by the Knowledge-to-Action framework, this study develops a clinician-in-the-loop DL pipeline to enhance reproducibility, prognostic accuracy, and clinical trust. Multi-center CT data from 999 patients across 12 public datasets were analyzed using five DL models (3D Attention U-Net, ResUNet, VNet, ReconNet, SAM-Med3D), benchmarked against expert contours on whole and click-point cropped images. Segmentation reproducibility was assessed using 497 PySERA-extracted radiomic features via Spearman correlation, ICC, Wilcoxon tests, and MANOVA, while prognostic modeling compared supervised (SL) and semi-supervised learning (SSL) across 38 dimensionality reduction strategies and 24 classifiers. Six physicians qualitatively evaluated masks across seven domains, including clinical meaningfulness, boundary quality, prognostic value, trust, and workflow integration. VNet achieved the best performance (Dice = 0.83, IoU = 0.71), radiomic stability (mean correlation = 0.76, ICC = 0.65), and predictive accuracy under SSL (accuracy = 0.88, F1 = 0.83). SSL consistently outperformed SL across models. Radiologists favored VNet for peritumoral representation and smoother boundaries, preferring AI-generated initial masks for refinement rather than replacement. These results demonstrate that integrating VNet with SSL yields accurate, reproducible, and clinically trusted CT-based lung cancer prognosis, highlighting a feasible path toward physician-centered AI translation.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Click, Predict, Trust".
Jane: Here's the gist of the paper. Lung cancer is the leading cause of cancer death, with CT central to screening, prognosis, and treatment This study shows that VNet, integrated with SSL, can deliver accurate, reproducible, and clinically trusted tools for CTbased lung cancer prognosis Methodological Framework The research employed a Knowledge-to-Action (KTA) framework to guide the development of a clinician-in-the-loop pipeline to improve reproducibility, prediction, and clinical trust The study analyzed multi-center lung cancer CT data from 999 patients across 12 public datasets Five deep learning models (3D Attention U-Net, ResUNet, VNet, ReconNet, SAM-Med3D) were benchmarked against expert contours on whole and click-point cropped images Segmentation reproducibility was tested using 497 PySERA-extracted radiomics features with various statistical tests Six physicians qualitatively evaluated masks across 21 questions spanning seven domains to assess clinical meaningfulness and workflow integration Model Performance and Stability VNet-based segmentations achieved the best geometric accuracy (Dice 0.83±0.07, IoU 0.71±0.09) and radiomics stability (averaged correlation coefficient=0.76, ICC=0.65) Semi-supervised learning (SSL) consistently outperformed supervised learning (SL) across models The SSL configuration involving LASSO–LGBM–VNet achieved the highest test accuracy (0.88 ± 0.003 accuracy, 0.83 ± 0.004 F1) Clinical and Qualitative Insights Qualitative assessments revealed that radiologists favored VNet for peritumoral representation and smoother boundaries Experts p referred AI to provide initial masks for refinement rather than replace physicians Physicians highlighted that AI masks often introduced noisy, unstable boundaries instead of biologically meaningful differences, limiting prognostic stability Overall assessments indicated no significant differences among the five models in diagnostic or prognostic success based on Friedman tests The study concluded that VNet emerged as the most robust model, achieving superior geometric accuracy and strong radiomics reproducibility The findings demonstrate that SSL pipelines with VNet can enhance prognostic prediction, while clinical reliability requires outcome-linked metrics and physician input Future work includes developing a dedicated clinical software platform integrating VNet-based segmentation with click-point and gaze-tracking functionality The study addressed 10 of 11 barriers to routine adoption of AI in the clinic through its integrated evaluation framework ACKNOWLEDGEMENTS This study was supported by the Virtual Collaboration Group (VirCollab, www.vircollab.com) and the Technological Virtual Collaboration (TECVICO CORP.) based in Vancouver, Canada We gratefully acknowledge funding from the Natural Sciences and Engineering Research Council of Canada (NSERC) Award RGPIN-2023-0357, and Discovery Horizons Grant DH-2025-00119, as well as the UBC Department of Radiology 2023 AI Fund CONFLICT OF INTEREST Drs.
Tom: Mohammad R.
Jane: Salmanpour, Mehdi Maghsudi, Arman Gorji, and Ms.
Tom: Sonya Falahati are affiliated with TECVICO Corp The other co-authors declare no relevant conflicts of interest or disclosures DATA AND CODE AVAILABILITY All code is publicly shared at: https://github.com/MohammadRSalmanpour/Clinician-in-the-Loop-AI-Segmentation-for-CT-BasedPrognosis/tree/main REFERENCE 1.
Paper summary: Jane: So, wrapping up this discussion on "Click, Predict, Trust: Clinician-Guided and Clinician-Evaluated AI Segmentation for Lung Cancer CT-Based Prognosis within the Knowledge-to-Action Framework," what does it really mean for the people listening who aren't deep in the AI weeds?
Tom: It means they’ve shown a concrete pathway to take complex deep learning segmentation models, like VNet, and make them more trustworthy for serious medical use by forcing them through a process that involves both high accuracy testing and direct clinical feedback.
Lu: Essentially, the paper demonstrates that putting an AI tool into a system where it supports the physician's initial mask creation instead of completely replacing it addresses major issues around trust and workflow integration in healthcare.
Meng: For those of us building these things, this study confirms that focusing on reproducibility and stability—like VNet achieved with its zero point eight three dice score—is what actually translates into a reliable tool rather than just a cool algorithm on a laptop.
Jane: Right, so the authors are pointing toward using semi-supervised learning pipelines with models like VNet as the most suitable starting point because they balance high performance with that necessary clinical alignment. The implication is that for AI in diagnostics, success isn't just about getting a high accuracy score; it’s about proving it works consistently when a human expert evaluates the output.
Tom: And they clearly show how to test for those things by using outcome-linked metrics and physician input, which addresses the skepticism barrier head-on. This moves us toward practical implementation rather than just theoretical potential.
Conclusion: Tom: So, we've been looking at how this study tackled that whole pipeline for lung cancer prognosis using VNet and semi-supervised learning to build trust in AI tools, and now we’re hitting the conclusion on this paper by Salmanpour and his team.
Jane: Right. The title itself is pretty clear: Click, Predict, Trust. It tells us the core idea isn't just about getting a good segmentation mask; it's about making sure that mask actually helps the doctor make a decision they trust.
Lu: What’s really interesting here is how they framed it using this Knowledge-to-Action framework. It’s not just building a model and hoping for the best; they built a whole system designed around how doctors actually work in the clinic to improve reproducibility and clinical trust.
Meng: I mean, taking those five different deep learning models—VNet, ResUNet, ReconNet, SAM-Medthree dee—and finding that VNet was the most robust one based on its geometric accuracy and radiomics stability metrics is a solid engineering result.
Tom: That’s what I like to see. It’s not just about which model has the highest test accuracy number; it's about which model stays consistent when you try to repeat the measurement, and VNet delivered that.
Jane: And they did this by testing it against expert contours and then having physicians look at those masks and give qualitative feedback across seven different domains to see if they felt it was useful in a real workflow.
Lu: That physician input is crucial because it shows where the AI might actually be failing in terms of clinical meaning, not just mathematical precision. It suggests that VNet's smoother boundaries were preferred by radiologists for peritumoral representation.
Meng: So, the main implication for us at the startup side is that we need to focus on that stability and clinical alignment over chasing the absolute highest accuracy score because consistency is what matters when you’re actually putting something in a hospital setting.
Tom: Exactly. The authors conclude that while VNet was the best model, it’s not a magic solution; it needs those outcome-linked metrics and physician input to be truly reliable for clinical use.
Jane: It sounds like the path forward isn't just about training better models, but about building an integrated system where the AI acts as a supportive tool for initial refinement rather than a final answer generator.
Lu: That’s the direction they point toward—developing platforms that integrate that VNet segmentation with things like click-point tracking so it becomes a more comprehensive diagnostic aid.
Meng: And I think that's where the real work is going to be, connecting the model output directly into a usable clinical software platform.
Tom: So, we’ve seen how they built this from data analysis all the way to clinical testing and concluded that VNet is a strong contender, but the next hurdle is making sure it actually fits smoothly into the doctor's day.
More episodes
- 2603.28113-The multiplicative Lipschitz bound as an inductive bias
- 2603.28595-Optimistic Actor-Critic with Parametric Policies for Linear Markov Decision Processes
- 2603.29765-Training-Free Dynamic Upcycling of Expert Language Models
- 2605.00778-Observable Performance Does Not Fully Reflect Adaptive System Organization: A Multi-Level Analysis of Gait Dynamics Under Occlusal Constraint
- 2605.06906-TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond
- 2605.09165-Sparse Layers are Critical to Scaling Looped Language Models
- 2605.09439-Inverse Design for Conditional Distribution Matching
- 2605.10313-Signature Approach for Contextual Bandits with Nonlinear and Path-dependent Rewards: Regret Bound and Statistical Inference
- 2605.10878-Minimum Neural Weight Norm = Kolmogorov Complexity
- 2605.11617-MIST: Reliable Streaming Decision Trees for Online Class-Incremental Learning via McDiarmid Bound