APOLO: Automatic Prompt Optimization for Ontology Learning
cs.AI
Submitted: 2026-09-28
Updated: 2026-09-28
Comments: Accepted at the Posters and Demos Track of the International Semantic Web Conference (ISWC 2026)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Ontology Learning (OL) from text has advanced with the emergence of Large Language Models (LLMs), but it remains challenging due to the limited availability of annotated training data and the
Terminology
Abstract
Ontology Learning (OL) from text has advanced with the emergence of Large Language Models (LLMs), but it remains challenging due to the limited availability of annotated training data and the difficulty of adapting LLMs to perform OL effectively. We address this via APOLO - Automatic Prompt Optimization for Ontology Learning, by casting OL as an explicit prompt optimization problem over LLM modules. To obtain training data, we employ a multi-agent system that generates text-ontology pairs from existing expert-curated ontologies. We then propose two ontology learner architectures: a greedy and an autoregressive learner, and optimize both using GEPA, a greedy evolutionary prompt optimizer built on DSPy. Experiments on two ontologies - a biomedical (DOID) and a plant ontology (PO) show consistent improvements after optimization across nearly all model and mode combinations, with autoregressive learners achieving the largest gains. Our results demonstrate that prompt optimization is a viable and lightweight alternative to fine-tuning for OL, and that the autoregressive formulation better captures ontological structure than the greedy approach.
Sources
- LLMs4OL: Large Language Models for Ontology Learning
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- A Description Logic Primer
- Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Study
- Devstral: Fine-tuning Language Models for Coding Agent Applications
- From human experts to machines: An LLM supported approach to ontology and knowledge graph construction
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems