OTel: Open Telco AI Datasets, Benchmarks, and Models
cs.AI
Submitted: 2026-10-06
Updated: 2026-10-14
Comments: Pre-print
Code: https://github.com/farbodtavakkoli/OTel
License: http://creativecommons.org/licenses/by/4.0/
The gist: We present Open Telco (OTel), an open telecom AI resource that releases derived telecom datasets for retrieval, reranking, instruction tuning, and safety/abstention, together with 30 full-parameter
Terminology
Abstract
We present Open Telco (OTel), an open telecom AI resource that releases derived telecom datasets for retrieval, reranking, instruction tuning, and safety/abstention, together with 30 full-parameter post-trained baselines spanning 10 embedding models, 3 rerankers, and 17 language models. The community has already engaged substantially with the resource: as of May 3, 2026, the released models have been downloaded over 16 million times and the project has received 157+ pieces of media coverage worldwide. Building on prior open telecom datasets and benchmarks, OTel provides documented telecom data sources, held-out evaluation partitions, trained embedding models, rerankers, context-grounded LLMs, and safety/abstention data in one unified resource. Each baseline starts from an open-weight model and is post-trained on OTel-derived data using an open training recipe, then evaluated on held-out OTel evaluation partitions. OTel post-training improves performance across all three model families: embedding retrieval reaches 93.1% NDCG@10, reranking reaches 0.947 MRR@10, and language-model correctness reaches 87.8%. We release OTel as a reproducible starting point and invite the community to expand the data, improve embedding and reranking models, and build stronger context-grounded telecom LLMs.
Sources
- TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving
- TeleTables: A Benchmark for Large Language Models in Telecom Table Interpretation
- ORAN-Bench-13K: An Open Source Benchmark for Assessing LLMs in Open Radio Access Networks
- TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledge
- Reasoning Language Models for Root Cause Analysis in 5G Wireless Networks
- TelecomGPT: A Framework to Build Telecom-Specfic Large Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems