The Invisible Gap: Romanized Indic Generation Fails Where Automatic Metrics Succeed
cs.CL, cs.AI
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/MadhuBeesetty/llm-romanization
Terminology
Sources
- M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation
- RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization
- Script Gap: Evaluating LLM Triage on Indian Languages in Native vs Romanized Scripts in a Real World Setting
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data