Multi-head Quantum Neural Networks: Replacing Transformer Blocks with NISQ Modules inside a 30-Billion-Parameter LLM
quant-ph, cs.AI, cs.LG
Submitted: 2026-11-11
Updated: 2026-11-11
Terminology
Sources
- Quantum Large Language Models via Tensor Network Disentanglers
- Classical Neural Networks on Quantum Devices via Tensor Network Disentanglers: A Case Study in Image Classification
- Quantum-enhanced Large Language Models on Quantum Hardware via Cayley Unitary Adapters
- Hybrid Quantum Transformer for Language Generation
- Quantum-Enhanced LLM Efficient Fine Tuning
- Quantum Knowledge Distillation for Large Language Models
- Quantum-Enhanced Natural Language Generation: A Multi-Model Framework with Hybrid Quantum-Classical Architectures
- Quantum Self-Attention Neural Networks for Text Classification
- QKSAN: A Quantum Kernel Self-Attention Network
- Quantum Adaptive Self-Attention for Quantum Transformer Models
- Qwen3 Technical Report
- ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
- The Unreasonable Ineffectiveness of the Deeper Layers
- Streamlining Redundant Layers to Compress Large Language Models
- SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks
- Synthesis of Quantum Logic Circuits
- Quantum-state preparation with universal gate decompositions
- Layered Uploading for Quantum Convolutional Neural Networks
Related papers
- Computational regimes in matrix-product-state-based quantum trajectory simulations
- Toward chemically accurate quantum simulations on quantum hardware: A quantum-HPC hybrid approach
- Transversal surface-code game with reconfigurable qubits
- Fulqrum: a generalized framework for quantum subspace diagonalization
- Flux-Activated Resonant Control of a Bosonic Quantum Memory
- Machine learning the effects of many quantum measurements