U4RASD at KnowledgeGraphEval-2026: Ontology-Constrained Encoder and LLM Systems for Arabic Relation Extraction

arXiv:2610.12742 · cs.CL · Submitted 2026-10-08 · Read on arXiv

cs.CL

Submitted: 2026-10-08

Updated: 2026-10-08

Comments: 20 pages. System description paper for the KnowledgeGraphEval 2026 Shared Task at ArabicNLP 2026

Code: https://github.com/SinaLab/sinatools

License: http://creativecommons.org/licenses/by/4.0/

The gist: This paper details our submission to KnowledgeGraphEval 2026 Subtask 2 on directed Arabic relation extraction.

Terminology

Abstract

This paper details our submission to KnowledgeGraphEval 2026 Subtask 2 on directed Arabic relation extraction. We explored encoder-based and large language model approaches for predicting one of 40 relations or no relation from an Arabic sentence and a subject-object pair. Our encoder systems use typed entity markers and separate relation-existence and relation-classification heads, while our LLM systems fine-tune Yehia and Qwen3.5 with QLoRA and ontology-constrained prediction. Our best system, an ensemble of Yehia-RE, Qwen-RE, and TypedPair, achieved a micro-F1 score of 94.06 and ranked 1st in Subtask 2. Yehia-RE (full-vocabulary) achieved 92.98, while the best encoder and Qwen-RE achieved 92.69 and 91.94 respectively. Our results highlight the importance of constrained prediction and complementary modeling approaches for Arabic relation extraction.

Sources

Related papers