ConlangBench: Exploring Language Knowledge and Learning in LLMs through Diverse Constructed Languages

arXiv:2608.03505 · cs.CL · Submitted 2026-08-04 · Read on arXiv

Jinhong Jeong, Seungyeop Yi, Sangah Lee, Youngjae Yu

cs.CL

Submitted: 2026-08-04

Comments: 29 pages, 12 figures, 17 tables

Code: https://github.com/lipu-linku/sona

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Benchmark — 8× in this paper · explained in 2 episodes
Generalization — 3× in this paper · explained in 14 episodes
Low-Resource Languages — 3× in this paper · explained in 4 episodes
Papers — 3× in this paper · explained in 3 episodes
Semantic Similarity — 3× in this paper · explained in 2 episodes
Benchmarking — 2× in this paper · explained in 4 episodes
Language Models (LLMs) — 2× in this paper · explained in 2 episodes
Large Language Models (LLMs) — 2× in this paper · explained in 9 episodes
Trace — 2× in this paper · explained in 2 episodes
Core — 1× in this paper · explained in 2 episodes
Embeddings — 1× in this paper · explained in 2 episodes
Hyperparameters — 1× in this paper · explained in 2 episodes
Resource Constraints — 1× in this paper · explained in 5 episodes
Semantic Preservation — 1× in this paper · explained in 2 episodes
Thinking mode — 1× in this paper · explained in 2 episodes
Weight Decay — 1× in this paper · explained in 2 episodes

Sources

Related papers