QQ: A Language Metadata Toolkit for Multilingual NLP

arXiv:2603.00620 · cs.CL · Submitted 2026-02-28 · Read on arXiv

cs.CL

Submitted: 2026-02-28

Updated: 2026-08-31

Comments: EMNLP 2026: System Demonstrations

Code: https://github.com/WPoelman/qwanqwa

License: http://creativecommons.org/licenses/by/4.0/

The gist: Multilingual NLP research increasingly involves hundreds or thousands of languages across different datasets.

Terminology

Abstract

Multilingual NLP research increasingly involves hundreds or thousands of languages across different datasets. Managing, discovering, and reporting language metadata becomes a common hurdle at these scales. We present QQ, a metadata toolkit and browser explorer. QQ compiles language metadata sources into a graph of language varieties, scripts, regions, identifiers, names, and relations, and exposes it through a Python API, a command-line interface, and a browser-based explorer. Users can normalize identifiers, retrieve metadata, traverse relations, and discover which external resources contain a language. We demonstrate QQ on three workflows: an audit of the HuggingFace Hub, linking resources that use different identifier systems, and generating reproducible language-reporting tables. QQ supports FAIR-oriented metadata practices through versioning, open formats, and reusable interfaces.

Sources

Related papers