PolyRoute: A Twelve-Language and Code-Mixed Benchmark for Typed-Decision Routing, with Baselines and a Leaderboard
cs.CL, cs.AI
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/NandhaKishorM/laya
Terminology
Sources
- XNLI: Evaluating Cross-lingual Sentence Representations
- XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
- MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages
- GLUECoS : An Evaluation Benchmark for Code-Switched NLP
- Datasheets for Datasets
- The State and Fate of Linguistic Diversity and Inclusion in the NLP World
- With Little Power Comes Great Responsibility
- What Will it Take to Fix Benchmarking in Natural Language Understanding?
- How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
- Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models
- Language Model Tokenizers Introduce Unfairness Between Languages
- Are All Languages Created Equal in Multilingual BERT?
- How multilingual is Multilingual BERT?
- Unsupervised Cross-lingual Representation Learning at Scale
- Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- On Calibration of Modern Neural Networks
- Selective Classification for Deep Neural Networks
- Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions
- Large Language Models Are Not Robust Multiple Choice Selectors
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data