Quantum Knowledge Distillation: State-of-the-art, Applications and Open Problems
quant-ph
Submitted: 2026-11-05
Updated: 2026-11-05
Comments: 21 pages, 3 figures, 4 tables
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Distilling the Knowledge in a Neural Network
- Research progress on quantum neural networks and quantum machine learning
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
- FitNets: Hints for Thin Deep Nets
- CSAKD: Knowledge Distillation with Cross Self-Attention for Hyperspectral and Multispectral Image Fusion
- Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
- Quantum Knowledge Distillation for Large Language Models
- Staged Hybridisation for Visual Quantum Reinforcement Learning via Knowledge Distillation
- Towards Fair Benchmarking of Quantum Transfer Learning for Visual Classification
- From Foundation ECG Models to NISQ Learners: Distilling ECGFounder into a VQC Student
- Quantum-enhanced Large Language Models on Quantum Hardware via Cayley Unitary Adapters
- Distilling the knowledge with quantum neural networks
- LLM-QFL: Distilling Large Language Model for Quantum Federated Learning
- Knowledge Distillation for Variational Quantum Convolutional Neural Networks on Heterogeneous Data
- Photonic Quantum-Enhanced Knowledge Distillation
- QuLoC: Photonic Quantum-Assisted Low-Rank LLM Compression
- Exploring the Impact of Temperature Scaling in Softmax for Classification and Adversarial Robustness
- Fast Tensorization of Neural Networks via Slice-wise Feature Distillation
- Tensor train decompositions on recurrent networks
- QYOLO: Lightweight Object Detection via Quantum Inspired Shared Channel Mixing
Related papers
- Computational regimes in matrix-product-state-based quantum trajectory simulations
- Toward chemically accurate quantum simulations on quantum hardware: A quantum-HPC hybrid approach
- Transversal surface-code game with reconfigurable qubits
- Fulqrum: a generalized framework for quantum subspace diagonalization
- Flux-Activated Resonant Control of a Bosonic Quantum Memory
- Machine learning the effects of many quantum measurements