Personalized Korean Lipreading as Visual Speech Recognition: Transfer, Census and Adaptation on OLKAVS

arXiv:2609.28988 · eess.AS, cs.CL, cs.CV · Submitted 2026-09-24 · Read on arXiv

eess.AS, cs.CL, cs.CV

Submitted: 2026-09-24

Updated: 2026-09-24

Comments: Submitted to ICASSP 2027. 4 pages plus references

Code: https://github.com/IIP-Sogang/olkavs-avspeech

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Personalization — 13× in this paper · explained in 2 episodes
• Adaptation — 10× in this paper · explained in 1 episode
• Fine-Tuning — 6× in this paper · explained in 5 episodes
• Benchmark — 4× in this paper · explained in 2 episodes
• Transformer — 4× in this paper · explained in 2 episodes
• Actor — 1× in this paper · explained in 3 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes

Sources

• Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language
• LoRA: Low-Rank Adaptation of Large Language Models
• The Lipreading Gap: Do VSR Models Perceive Visual Speech Like Human Lipreaders?

Related papers

• Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs
• X-VC: Zero-shot Streaming Voice Conversion in Codec Space
• Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers
• VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation
• Conditional Flow Matching for Visually-Guided Acoustic Highlighting
• Anonymization, Not Elimination: Utility-Preserved Speech Anonymization