Adaptive Virtual PIN-Button Recognition on Passive NFC Cards via Domain Adaptation and Uncertainty Quantification

arXiv:2611.05719 · eess.SP · Submitted 2026-11-03 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.

Rosa: We're looking at the paper: "Adaptive Virtual PIN-Button Recognition on Passive NFC Cards via Domain Adaptation and Uncertainty Quantification".

Dev: Here's the gist of the paper. Passive Near Field Communication (NFC) cards are widely used for access control and authentication but provide no native interface for reliable user input This paper presents a practical virtual input framework that enables reliable PIN-button entry on passive NFC cards using a 12-button interface without modifying the commercial NFC card or the ISO/IEC 15693 communication protocol.

Rosa: Framework Development The authors developed a multidomain adaptation framework that jointly learns interaction representations invariant to both card and reader variations.

Dev: This framework addresses the challenge of hardware compatibility by creating a practical 12-button virtual PIN pad using unmodified passive commercial NFC cards.

Rosa: The system utilizes a model-agnostic uncertainty quantification protocol based on conformal prediction to estimate recognition confidence.

Paper summary: Rosa: So we're talking about this paper called "Adaptive Virtual PIN-Button Recognition on Passive NFC Cards via Domain Adaptation and Uncertainty Quantification." Basically, they’ve got a problem with passive NFC cards—they're great for access control but you can't really input a PIN reliably because there isn't a native way to do it.

Dev: Right, so the core idea is to build this practical virtual input framework that lets you put in a PIN using just twelve buttons on those standard cards without changing the card itself or the ISO fifteen thousand six hundred ninety-three protocol <ref:2611.05719#pg1,practical virtual input framework that>. It tackles the issue of signal variations across different cards and readers.

Taro: And they claim this works by developing a multidomain adaptation framework that learns representations for interactions that are consistent whether you're using a different card or a different reader. That sounds like they're trying to make it work everywhere, which is key for real-world use.

Rosa: Exactly, and to handle the uncertainty of those inputs, they introduce a model-agnostic uncertainty quantification protocol based on conformal prediction. This means the system figures out how confident it is in its recognition before accepting an input.

Dev: If that confidence level is too low, the system just asks for another input instead of guessing, which helps keep things reliable in a real-time loop scenario. That’s a safety feature you’d want when you're controlling something important.

Taro: They model how a physical button coil perturbs the magnetic coupling between the reader antenna, the card antenna, and that button coil to create location-dependent radio frequency responses. This is the physics underpinning how they get those twelve distinct buttons recognized <ref:2611.05719#pg1>.

Rosa: And to test this physical model, they define something called the effective card impedance as Zh equals Zc plus omega squared M two b over Zb to describe that interaction mathematically. They also measure a pairwise RF-response separability score Sbq to see how different the response shapes are between two button positions.

Dev: The training part is where it gets interesting, too. They use a correlation alignment, or CORAL, framework for multi-target domain adaptation to handle recognizing those virtual buttons across different cards and readers simultaneously. They optimize a multi-target deep CORAL objective to align the source button classifications with the card, reader, and combined card and reader domains.

Taro: I’m curious how that affects real-world failure modes? If the system is adapting to different environments, how gracefully does it recover when it encounters something completely new or unexpected during operation?

Rosa: Well, they use conformal prediction for uncertainty quantification to get calibrated prediction sets. This gives them an operational measure of model uncertainty, and then they use that to decide whether an input gets accepted immediately or if a re-input is required.

Dev: The results show that this domain adaptation helps the recognition accuracy improve quite a bit—it goes from ninety-three point seventy-five percent for the deep learning model up to ninety-five point forty-two percent, and from eighty-five point zero zero percent to eighty nine point eleven percent for the Random Forest model.

Taro: So, when you look at the average recognition accuracies across all those different hardware configurations they tested, what do you see? Is it consistent across the board?

Rosa: The conformal prediction based adaptive recognition framework achieves average recognition accuracies of ninety-six point eighty-five percent for the deep learning model and ninety point fifty-five percent for the Random Forest model across diverse hardware setups. They even found that the CP-based adaptive method gets the highest deep learning accuracy in all three domains, beating Euclidean distance based recognition.

Dev: That’s a solid comparison because it shows that their uncertainty-aware method balances recognition accuracy with user interaction overhead reasonably well, which is important for a practical system. The computational pipeline itself takes an average of sixty-five point fifty-seven milliseconds to process each captured response and make the decision.

Taro: What about limitations? If you're trying to deploy this on a specific piece of hardware, what's the catch? Does it only work with certain types of readers or cards, or is there something about the physical setup that can mess it up?

Rosa: They do note that practical deployment requires a reader capable of acquiring button-dependent radio frequency signatures with enough sensitivity. And they mention that the adaptive recognition mechanism does request additional measurements when the available evidence isn't sufficient, which means it relies on multiple inputs in those ambiguous moments.

Dev: So, to wrap up this paper, "Adaptive Virtual PIN-Button Recognition on Passive NFC Cards via Domain Adaptation and Uncertainty Quantification," it’s about creating a robust way to input data onto passive NFC cards without changing the underlying communication standard.

Taro: It seems like they've really focused on making the system resilient to the inevitable variations you see when you move hardware around or use different readers in different locations.

Rosa: Right, and by combining that domain adaptation with conformal prediction for uncertainty quantification, they’ve built a framework that can handle input recognition reliably across those varying conditions.

Dev: The implication here is that we can potentially make passive NFC cards much more usable for authentication or access control applications in real-world scenarios where hardware isn't perfectly controlled in a lab.

Conclusion: Rosa: So we’re wrapping up this look at "Adaptive Virtual PIN-Button Recognition on Passive NFC Cards via Domain Adaptation and Uncertainty Quantification." Basically, these authors made a way to get reliable PIN input on regular passive NFC cards without changing the card or its communication protocol.

Dev: Right, so they built this framework that uses adaptation and uncertainty quantification to handle the messy reality of different cards and readers. It’s about making it work everywhere.

Taro: The core is using physical button positions to create unique radio frequency responses on those cards, which they then use a deep learning model to recognize.

Rosa: And the key part for me is how they handle when things get noisy or inconsistent. They use conformal prediction to figure out their confidence in an input and ask for another one if it’s not sure. That’s crucial for real-world testing, outside of a clean lab setting.

Dev: I see that uncertainty quantification protocol as the safety net here, ensuring the system doesn't accept a wrong PIN just because its model isn't totally certain about it. The results show they got accuracy improvements from ninety-three point seven five percent to ninety-five point four two percent for the deep learning model.

Taro: That improvement across different card and reader configurations is what’s really interesting for me. It means the system is actually robust when the environment changes, not just when you test it in one perfect setup.

Rosa: Exactly, and they found that their adaptive method achieved higher recognition accuracy on the deep learning model than a standard distance-based approach across all three domains they tested. That’s a good sign for practical deployment.

Dev: The computational cost is also something I looked at, and it takes about sixty-five point five seven milliseconds to process each response and decide whether to accept or ask for more input. It’s fast enough for most real-time applications.

Taro: So, the big picture here is that we can add this layer of adaptive intelligence to passive NFC cards so they become much more reliable for access control in varied conditions. But what happens when the world throws something completely outside of what their model has seen? That’s the next question I have.

Dickson Akuoko Sarpong, Hongzhi Guo

University of Nebraska–Lincoln

eess.SP

Submitted: 2026-11-03

Updated: 2026-11-03

Comments: Extended version of work presented at IEEE SECON 2026. Submitted to IEEE Internet of Things Journal

Code: https://github.com/dicksonakuoko/Virtual-NFC-Card-PIN-Pad

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 92/100

The gist: Passive Near Field Communication (NFC) cards are widely used for access control and authentication but provide no native interface for reliable user input This paper presents a practical virtual…

Key concepts

Multidomain Adaptation
This technique allows the system to learn how to recognize virtual buttons consistently across many different NFC cards and reader setups. It helps the model become robust against variations in hardware while maintaining accurate recognition performance for all targets.
Conformal Prediction
This method is used to estimate how confident the system is about its recognition results. It creates a set of possible outcomes (a prediction set) that accounts for uncertainty, allowing the system to know when it needs more information or when an input should be accepted immediately.
Correlation Alignment (CORAL)
CORAL is a framework used for multi-target domain adaptation. In this paper, it helps align the features learned from different NFC cards and readers so that the recognition model can generalize better across these varied environments for virtual button identification.
Uncertainty Quantification
This involves measuring how uncertain the recognition model is about its predictions. By using conformal prediction, the system can determine if it has enough evidence to accept an input or if it should ask the user to enter a PIN again, making the process adaptive.

Terminology

Summary

Passive Near Field Communication (NFC) cards are widely used for access control and authentication but provide no native interface for reliable user input This paper presents a practical virtual input framework that enables reliable PIN-button entry on passive NFC cards using a 12-button interface without modifying the commercial NFC card or the ISO/IEC 15693 communication protocol. p. 0

Framework Development

The authors developed a multidomain adaptation framework that jointly learns interaction representations invariant to both card and reader variations. This framework addresses the challenge of hardware compatibility by creating a practical 12-button virtual PIN pad using unmodified passive commercial NFC cards. p. 1 The system utilizes a model-agnostic uncertainty quantification protocol based on conformal prediction to estimate recognition confidence. p. 0 When confidence is insufficient, the system requests re-input; otherwise, accepted inputs are immediately confirmed through reader feedback. p. 0

Physical Modeling and Data Collection

The physical model describes how a movable passive button coil perturbs the magnetic coupling among the reader antenna, NFC card antenna, and button coil. The interaction is analyzed by defining the effective card impedance as Zh = Zc + ω 2M2b / Zb. p. 2 To evaluate distinguishability, the pairwise RF-response separability score Sbq is obtained, where larger values indicate greater differences between the frequency-dependent response shapes of two button positions. p. 3 Data collection involves building an SDR-based NFC testbed compliant with ISO/IEC 15693, integrating passive analog self-interference cancellation (SIC) and multiple commercial NFC cards and reader configurations. p. 1

Domain Adaptation and Model Training

The authors employ the Correlation Alignment (CORAL) framework for multi-target domain adaptation to handle cross-card and cross-reader virtual-button recognition. For the deep learning model, a multi-target Deep CORAL objective jointly optimizes source button classification and feature alignment with the CC, CR, and CCR target domains. p. 5 The source classification loss Lcls encourages the learned representation to remain discriminative for the virtual buttons. p. 6 For the Random Forest model, CORAL is applied as a standalone feature-alignment step before classifier training using principal component analysis (PCA). p. 6

Uncertainty Quantification and Adaptive Decision Making

A model-agnostic CP framework is used to quantify the uncertainty of virtual-button PIN-button recognition and improve decision reliability. The CP prediction set size provides an operational measure of the recognition model’s uncertainty or confidence. p. 7 The adaptive PIN-button entry protocol uses calibrated prediction sets and accumulated evidence to determine whether an input can be accepted or requires repetition. p. 1

Experimental Results and Comparison

Experimental results show that domain adaptation improves recognition accuracy from 93.75% to 95.42% for the deep learning (DL) model and from 85. p. 000% to 89.11% for the Random Forest model. p. 0 The CP-based adaptive recognition framework achieves average recognition accuracies of 96. p. 085% and 90.55% for the DL and Random Forest models, respectively, across diverse hardware configurations. p. 0 The CP-based adaptive method achieves the highest DL recognition accuracy across all three domains, comparing it favorably against Euclidean distance-based recognition. p. 2 The proposed CP-based adaptive method provides a favorable balance between recognition accuracy and user interaction overhead across both learning models. p. 1

Computational Efficiency and Deployment

The complete online computational pipeline requires an average of 65.57 ms to process each captured response and produce the corresponding accept-or-re-input decision. p. 1 The proposed framework enables virtual PIN-button input on unmodified commercial NFC cards without altering ISO/IEC 15693 communication. p. 0 Practical deployment requires a reader capable of acquiring button-dependent RF signatures with sufficient sensitivity. p. 0 The authors note that the adaptive recognition mechanism requests additional measurements when the available evidence is insufficient, reducing reliance on ambiguous single responses. p. 2

Conclusion

This paper presents a model-agnostic adaptive virtual PIN pad framework for passive NFC cards that integrates multidomain adaptation and conformal prediction. By exploiting position-dependent magnetic coupling among the reader, NFC card, and passive button coil, the framework produces distinguishable RF responses for twelve virtual button regions without modifying commercial NFC ID cards or the ISO/IEC 15693 protocol. p. 1 To address response variations across different cards and reader configurations, we employ a multidomain adaptation framework to improve recognition robustness. p. 0 Building on the adapted models, we develop a model-agnostic conformal prediction-based decision method that supports both deep learning and machine learning models and requests additional inputs when the accumulated evidence is insufficient for acceptance. p. 1 Experimental results demonstrate improved cross-domain recognition accuracy and effective uncertainty-aware PIN-button recognition across different card–reader configurations. p. 2 The DL model achieves higher empirical coverage and adaptive recognition accuracy while producing smaller prediction sets and requiring fewer re-inputs than the Random Forest model. p. 9 The Random Forest results also show that the proposed CP-based adaptive recognition framework can be applied across different card–reader configurations and is not restricted to a specific model architecture. p. 7

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Adaptive Virtual PIN-Button Recognition Framework

This framework can enable reliable PIN-button entry on unmodified commercial NFC cards using a 12-button interface without modifying the card or ISO/IEC 15693 communication protocol. It achieves this by jointly learning interaction representations invariant to both card and reader variations through a multi-target domain adaptation framework.

  1. Uncertainty Quantification for Adaptive Re-input

The system introduces a model agnostic uncertainty quantification protocol based on conformal prediction that estimates recognition confidence, allowing the system to request re-input when confidence is insufficient and immediately confirm accepted inputs otherwise. This ensures reliable user interaction by determining when confidence is insufficient, the system requests re-input; otherwise, accepted inputs are immediately confirmed through reader feedback.

  1. Robustness Against Domain Shifts

The multi-target domain adaptation framework is designed to reduce card- and reader-dependent variations while preserving button discriminative information across cross card, cross reader, and combined card reader domain shifts. This makes the recognition robust to diverse hardware configurations encountered in practical deployment.

  1. Model Agnostic Decision Protocol

The model agnostic conformal prediction based decision method supports both deep learning and machine learning models by determining whether a recognized input can be accepted or requires repetition based on calibrated prediction sets and accumulated evidence. This allows the framework to determine when an input is sufficiently reliable for acceptance and when re-input is required to obtain additional evidence.

  1. Performance Across Recognition Methods

The CP based adaptive method achieves the highest DL recognition accuracy across all three domains, demonstrating superior performance compared to Euclidean distance-based recognition and OpenMax methods in challenging scenarios like CCR. It also provides competitive results for Random Forest models while offering calibrated uncertainty estimation and adaptive re-input capabilities.

Sources

Related papers