JDCNet Uses Confidence Gated Privileged Modality Distillation for Cost Preserving X Ray Inference

arXiv:2603.29167 · cs.CV · Submitted 2026-03-31 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "JDCNet Uses Confidence Gated Privileged Modality Distillation for Cost Preserving X Ray Inference".

Jane: Here's the gist of the paper. We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path <ref:2603.29167#pg2>.

Tom: The validated result is scoped to the JDCNet transfer channel on this cohort and binary task <ref:2603.29167#pg6>.

Jane: Pruning redundant reasoning tokens The paper presents JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold <ref:2603.29167#pg5>.

Tom: This method is framed as a cost-preserving visual inference system where the deployed model must remain X-ray-only, with no additional inferencetime inputs or parameters <ref:2603.29167#pg2>.

Title and authors: Tom: The paper is titled "JDCNet Uses Confidence Gated Privileged Modality Distillation for Cost Preserving X Ray Inference," and it’s written by Bo Ma, Wei Qi Yan, Jinsong Wu, Hongjiang Wei, and Kun Liu. What do you make of that title?

Jane: It tells you immediately the two big constraints they are trying to manage: using a privileged modality during training while keeping the final deployment path fixed on X-ray only. The word "cost preserving" is key because it suggests they aren't just trying to get a better result; they are trying to keep the deployment footprint identical to something we already have in place.

Lu: They are tackling a systems-level problem here, which means they aren't just tweaking loss functions; they’re looking at the entire pipeline from training all the way through inference. This isn't about making one small part better, it’s about how different parts interact under strict constraints.

Meng: I worry that when you try to constrain things this tightly—like forcing a model to only use X-ray for deployment—you often hit walls where the gains on the training side don't translate perfectly to the actual test scenario.

Lalam: They are specifically looking at whether this privileged modality supervision can actually improve a deployed visual model without adding any extra inputs or parameters at inference time, which is a very specific and hard question to answer in this field.

The paper's summary: Tom: So what is the actual mechanism they propose? They introduce JDCNet, which is described as a confidence-gated CT-to-X-ray distillation framework where the CT teacher only supplies a target on training samples if its confidence goes above a certain threshold.

Jane: That gating mechanism sounds like it’s designed to filter out the noisy or unreliable signals from the CT scans during training, so you're not corrupting the student model with low-quality information. It’s about selectively leveraging that expensive context only when it’s actually trustworthy.

Lu: They define their student loss as this combination of a standard cross-entropy loss and an auxiliary loss, Laux, which is either a hard target or a temperature scaled soft KL divergence, but only applied to those high-confidence samples identified by that mask.

Meng: So the idea is they’re using the CT information not as constant supervision for every single image in the batch, but as a selective boost when the teacher is highly certain about its prediction. That sounds like a smart way to manage complexity during training.

Lalam: The paper points out that this formulation differs from other distillation methods because it uses a discrete or lightly-softened target instead of a fully-temperature-softened distribution, which they argue eliminates CT specific fine structure that doesn't help the X-ray feature space.

The paper's improvements: Tom: Now for the results, the headline evidence comes from patient level five fold cross validation on a public dataset of five hundred ten samepatient paired BIMCV patients <ref:2603.29167#pg1>. They found that two specific JDCNet configurations passed a fixed transfer gate against their supervised ResNet-eighteen baseline <ref:2603.29167#pg1,a fixed transfer gate against>.

Jane: The numbers there are pretty concrete: the three slice soft KL supervision yielded a gain of plus zero point zero three five, or thirty-five hundredths, which is about three and a half percent improvement over the baseline <ref:2603.29167#pg1>.

Lu: That relative recovery they calculate as two thirds of the CT teacher head room for those passing configurations—that suggests they are getting a significant signal from the CT view without breaking the deployment constraint.

Meng: I like that they isolated this gain by testing many other things, like logit distillation or attention transfer, and finding that only this confidence-gated auxiliary target passed the transfer gate, which strongly suggests the gating mechanism is doing the heavy lifting here.

Lalam: And they explicitly show that their supervised X-ray baseline and their JDCNet student are structurally identical in terms of deployed parameters and MACs at two hundred twenty-four by two hundred twenty-four input resolution, meaning zero extra inference time.

Conclusion: Tom: So to wrap up, the main implication is that using confidence-gated auxiliary targets as a transfer channel for CT to X-ray supervision works and preserves the deployment path. But Jane, what are the limitations they admit?

Jane: The limitation they state is that their validated result is scoped only to this single public cohort of five hundred ten samepatient BIMCV patients, and the gate they use is just a filter for that specific group <ref:2603.29167#pg1>. They aren't claiming this works outside of that specific patient population.

Lu: They also flag that the external validity outside of this paired cohort shows every method achieves sensitivity one point zero zero on the COVID positive class, but specificity drops toward zero on the normal class when tested independently. That’s a big warning about generalization.

Meng: From a production view, that lack of specificity on the normal class is concerning if we deploy this for screening where false positives are costly; it means we might be overly optimistic about how well it handles the healthy cases compared to our baseline.

Lalam: The authors say their most important next step is getting an independent samepatient paired CT to X-ray cohort, evaluated under the same rules without retraining, which is exactly what they need to do before any deployment claims can be made.

Tom: So the takeaway is that confidence-gated auxiliary targets are a promising way to get better results from a privileged modality without adding complexity at inference time. We'll keep an eye on that paired external validation work for the next paper.

Auckland University of Technology · Guilin University of Electronic Technology · Hikvision Technology Co. Ltd. · Hebei University of Technology

cs.CV

Submitted: 2026-03-31

Updated: 2026-11-03

Code: https://github.com/mabo1215/JDCNET

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 83/100

The gist: We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path <ref:2603.29167#pg2>.

Terminology

Summary

We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path <ref:2603. p. 0

Where the paper says it

1 JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference Bo Ma, Wei Qi Yan, Jinsong Wu, Hongjiang Wei, and Kun Liu Abstract—We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path. We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline.

29167#pg2>. The validated result is scoped to the JDCNet transfer channel on this cohort and binary task <ref:2603. p. 1
Where the paper says it

non-COVID X-ray classification; same-patient CT is available only during training; the deployed model receives Xray only at inference; and the headline evidence comes from patient-level 5-fold cross-validation on a public 510-patient same-patient paired BIMCV cohort. The validated result is scoped to the JDCNet transfer channel on this cohort and binary task; the paper does not claim clinical readiness, and independent paired-cohort replication remains necessary before any deployment claim.

29167#pg6>.

Pruning redundant reasoning tokens

The paper presents JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold <ref:2603.29167#pg5>. This method is framed as a cost-preserving visual inference system where the deployed model must remain X-ray-only, with no additional inferencetime inputs or parameters <ref:2603. p. 1

Where the paper says it

Contributions • Training-only privileged-modality formulation for cost-preserving X-ray inference. We frame CT-to-Xray transfer as a visual-systems problem in which CT can be used only during training and the deployed model must remain X-ray-only, with no additional inferencetime inputs or parameters.

29167#pg2>. The central systems question is whether privileged-modality supervision can improve the deployed visual model without increasing inferencetime modality acquisition, memory footprint, or latency—an evaluation problem about training-time signal routing under a fixed deployment budget <ref:2603. p. 1
Where the paper says it

The CT branch shapes only the training objective; the deployed graph remains a standard single-modality X-ray classifier whose parameter, MAC, peak memory, and CPU/GPU latency profile are identical to the supervised baseline (Section IV-G). The central systems question is therefore whether privileged-modality supervision can improve the deployed visual model without increasing inferencetime modality acquisition, memory footprint, or latency—an evaluation problem about training-time signal routing under a fixed deployment budget.

29167#pg1>.

How the training signal is built

JDCNet defines its student loss as LJDCNet = wCEfS(x(xr)), y+ λ LauxfS(x(xr))M, yˆctM, where M is a per-batch confidence mask selecting samples where the teacher confidence exceeds τgate <ref:2603.29167#pg4>. The auxiliary loss Laux is either the hard variant using CE on the CT argmax or the soft-KL variant using T2 KL divergence on the masked subset <ref:2603. p. 3

Where the paper says it

Define the per-batch confidence mask M = {i : maxc p ct i,c > τgate}, where τgate ∈ [0, 1] is a tuning hyperparameter. The student loss is LJDCNet = wCEfS(x (xr) ), y + λ LauxfS(x (xr) )M, yˆ ctM , (1) where wCE is the weighted cross-entropy used by the supervised baseline (BIMCV 113+/397− class weights), λ is the auxiliary-loss weight, and Laux is one of two variants: the hard variant uses CE(fS(x (xr) )M, yˆ ctM) on the CT argmax as a one-hot target; the soft-KL variant uses T 2 · KL(σ(fT (x (ct) )M/T) ∥ σ(fS(x (xr) )M/T)) on the masked subset.

29167#pg5>. This formulation differs from gated logit KD by using a discrete or lightly-softened target rather than a fully-temperature-softened distribution, eliminating CT-specific fine structure that does not translate to X-ray feature space <ref:2603. p. 3
Where the paper says it

JDCNet differs from gated logit KD (Eq. (2)) in three ways that are jointly decisive at 510-patient scale: the auxiliary signal is a discrete or lightly-softened target rather than a fully temperature-softened distribution, eliminating CT-specific fine structure that does not translate to X-ray feature space; the confidence filter is a hard mask rather than a smooth weight in [0, 1], so low-confidence teacher samples contribute zero auxiliary loss; and the true-label CE term always applies, so the teacher signal is strictly auxiliary.

29167#pg4>.

Where the gains come from

The headline evidence comes from patient-level 5-fold cross-validation on a public 510-patient same-patient paired BIMCV cohort <ref:2603.29167#pg2>. Two JDCNet configurations pass the fixed transfer gate: 3-slice soft-KL supervision yields ∆BA=+0. p. 9

Where the paper says it

JDCNet uses a confidence gate to apply a CT-teacher auxiliary target only where the teacher is confident, while the deployed model remains the same ResNet18 X-ray classifier used by the supervised baseline. On a 510- patient same-patient BIMCV cohort, two JDCNet configurations pass the fixed transfer gate: 3-slice soft-KL supervision (∆BA = +0.

035 (95% CI [+0. p. 0
Where the paper says it

On a 510-patient samepatient paired BIMCV cohort with patient-level 5-fold crossvalidation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice softKL supervision yields ∆BA=+0. 035 (95% CI [+0.

011, +0.057]) and mid-slice hard supervision yields +0. p. 0
Where the paper says it

035 (95% CI [+0. 057]) and mid-slice hard supervision yields +0.

033 ([+0.007, +0.058]) against the supervised ResNet-18 baseline. p. 0
Where the paper says it

We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline. On a 510-patient samepatient paired BIMCV cohort with patient-level 5-fold crossvalidation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice softKL supervision yields ∆BA=+0.

This relative recovery is computed as (BAJDCNet −BAXray)/(BACT −BAXray), yielding approximately two-thirds of the CT teacher head-room for the two passing configurations <ref:2603. p. 1
Where the paper says it

033, CI [+0. Relative recovery is computed as (BAJDCNet −BAXray)/(BACT −BAXray), yielding approximately two-thirds of the CT teacher head-room for the two passing configurations.

29167#pg6>.

Comparator Mechanism Isolation

Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. This isolates the confidence-gated auxiliary target as the supported transfer channel rather than attributing the result to backbone scale or extra deployed modules <ref:2603. p. 1

Where the paper says it

Under the same splits and gate, logit KD variants, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and the historical module-augmented comparator do not pass. This isolates the confidence-gated auxiliary target as the supported transfer channel rather than attributing the result to backbone scale, teacher representation, or extra deployed modules.

29167#pg6>. The CT teacher upper-bound rows establish that the privileged CT view does carry usable signal, while negative logit and contrastive rows rule out over-generalization. p. 7
Where the paper says it

The CT teacher upper-bound rows use the same ResNet18 architecture on CT representations and are training-only references: they establish whether the privileged modality contains transferable signal but are not deployable X-ray models. Transfer comparators include plain logit KD, confidence-gated logit KD, contrastive alignment, attention transfer, feature hints, the BiomedCLIP ViT-B/16 student, and the historical module-augmented pilot.

Deployment Cost Preservation

Table IV reports structural inference cost, showing that the supervised X-ray baseline, JDCNet student, and logit-KD students are the same ImageNet-pretrained ResNet-18 classifier at 224 × 224 input resolution after training. JDCNet has the same deployed parameters and MACs as supervised X-ray, meaning it adds zero inference-time cost relative to the baseline. p. 8

Where the paper says it

ROWS 1–3 SHARE THE SAME RESNET-18 X-RAY INFERENCE GRAPH, SO JDCNET ADDS ZERO INFERENCE-TIME COST RELATIVE TO SUPERVISED X-RAY. Row Params/MACs Mem.

The historical module-augmented pilot is listed separately because its extra student-side modules roughly double CPU latency at 224×224 despite a smaller parameter count, breaking the cost-preserving interpretation that the JDCNet student preserves. p. 8
Where the paper says it

18× wall time per epoch over the supervised X-ray run because the CT teacher is pre-trained once per view and then frozen; this overhead is paid only during training and is not part of the deployed cost. The module-augmented pilot is reported separately because its extra student-side modules roughly double CPU latency at 224×224 despite a smaller parameter count, which breaks the cost-preserving interpretation that the JDCNet student preserves.

Limitations and Future Work

The validated JDCNet result is established on a single public paired cohort (510 samepatient BIMCV patients, 113+/397−), and the fixed gate is a within-cohort evidence filter, not an out-of-cohort precision estimate. The most important next step is an independent same-patient paired CT–X-ray cohort with comparable label definitions, evaluated under the same paired-difference endpoint and per-fold win counts without retuning. p. 9

Where the paper says it

The fixed gate is a within-cohort evidence filter, not an out-of-cohort precision estimate, and its bootstrap CI overstates the precision available on a fresh patient population; a category-level cross-source control on independent non-COVID radiographs shows nearzero specificity, confirming that hospital source, projection geometry, and disease prevalence can erase the signal. The most important next step is an independent same-patient paired CT–X-ray cohort with comparable label definitions, evaluated under the same paired-difference endpoint and per-fold win counts without retuning.

The study reports that external validity outside the paired BIMCV cohort shows that every method achieves sensitivity 1. p. 9
Where the paper says it

Limitations and Future Work The study uses publicly released, de-identified imaging and reports only aggregate results; no patient re-identification or pixel redistribution is attempted. Data and generalization: the validated JDCNet result is established on a single public paired cohort (510 samepatient BIMCV patients, 113+/397−).

00 on the COVID-positive class while specificity collapses toward zero on the independent NORMAL class. p. 8
Where the paper says it

THESE ROWS DIAGNOSE INSTABILITY, SOURCE SHIFT, AND CAPACITY CONTROLS; THEY DO NOT ESTABLISH THE HEADLINE JDCNET CLAIM. Evidence layer Main observation Role Small paired fixed split 4 held-out paired patients, severe class imbalance Feasibility debug only 226-patient calibration scan Best gated-logit cell positive mean, CI crosses zero Instability diagnosis 510-patient logit-KD extension Gated logit KD negative or neutral across teacher views Mechanism audit Cross-source controls Source shift can erase specificity External-validity warning Foundation-model control BiomedCLIP tied with ResNet-18 supervised X-ray Capacity control upper-bound gate.

Conclusion

The result supports confidence-gated auxiliary targets as a promising CT-to-X-ray transfer channel while preserving the X-ray-only deployment path <ref:2603.29167#pg6>. Future work should prioritize paired external validation and transfer-channel replication <ref:2603. p. 0

Where the paper says it

Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. Confidence-gated auxiliary targets are therefore a more transferable channel than uniformly softened CT logits; the evidence is bounded to one paired cohort, so external pairedcohort replication is required before any deployment claim.

29167#pg6>. The paper does not claim clinical readiness, and independent paired-cohort replication remains necessary before any deployment claim. p. 1
Where the paper says it

non-COVID X-ray classification; same-patient CT is available only during training; the deployed model receives Xray only at inference; and the headline evidence comes from patient-level 5-fold cross-validation on a public 510-patient same-patient paired BIMCV cohort. The validated result is scoped to the JDCNet transfer channel on this cohort and binary task; the paper does not claim clinical readiness, and independent paired-cohort replication remains necessary before any deployment claim.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Confidence-gated X-ray inference model that uses a CT teacher only on samples where its confidence exceeds a threshold, preventing low-confidence predictions from corrupting the student training signal. This system can improve classification accuracy on X-ray by selectively leveraging anatomical context from CT during training while maintaining an identical, cost-preserving deployment path.

  2. A distillation framework that uses either a hard target (argmax) or a temperature scaled soft KL target only for high confidence teacher predictions, rather than applying a uniform loss to every sample. This prevents the student model from learning CT-specific fine structure that does not translate to X-ray feature space as noted in the discussion.

  3. A system that strictly adheres to an X-ray only inference graph, ensuring that the deployed model's parameter, MAC, and latency profile are identical to a supervised baseline, regardless of the complexity of the training supervision used. This guarantees cost preservation for edge deployment scenarios where CT is unavailable at test time.

Abstract

Training-only privileged-modality learning uses an expensive modality during training while keeping a single-modality deployment path. We study chest radiograph (X-ray) classification with same-patient computed tomography (CT) available only during training. JDCNet adds an auxiliary CT-teacher target, the teacher's argmax label or its softmax distribution through a Kullback--Leibler term (soft-KL), only on samples whose teacher confidence exceeds a threshold; the deployed model has the same ResNet-18 computation graph as the supervised baseline. On 510 same-patient pairs from the public BIMCV-COVID19 releases of the Valencian Region Medical ImageBank (113 COVID-19, 397 non-COVID), with patient-level five-fold cross-validation and three seeds, 15 of 16 adaptively explored JDCNet configurations improved mean balanced accuracy (BA) over the supervised baseline (average +0.020), but none remained significant after Holm adjustment. In a pre-registered experiment with 240 batch-matched supervised restarts on the same splits, batch size had no detectable effect on the baseline (BA 0.620 versus 0.625), and when both methods selected one of 16 runs per cell on the validation partition, JDCNet exceeded supervised training by +0.037 BA (95% confidence interval +0.016 to +0.058; patient-level +0.007 to +0.068). Logit distillation and contrastive alignment did not help. Teacher diagnostics indicate that the gate acts mainly as CT-informed sample weighting. All models, including JDCNet, performed at chance on an external radiograph set. Confidence-gated CT supervision thus gives a small within-cohort advantage on one public cohort and a binary task; generalization requires independent paired replication.

Sources

Related papers