Validating FKG.in: Soundness Assessment in LLM-Augmented Indian Food Knowledge
cs.AI, cs.CL, cs.IR, cs.LG
Submitted: 2026-08-29
Updated: 2026-10-27
Comments: 15 pages, 2 figures, 5 tables, 27 references
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: The online culinary ecosystem is increasingly populated by recipe content generated, modified, or summarized by Large Language Models (LLMs).
Terminology
Abstract
The online culinary ecosystem is increasingly populated by recipe content generated, modified, or summarized by Large Language Models (LLMs). While often plausible, such outputs may contain hallucinated ingredients, misrepresented quantities, or culturally implausible combinations, limiting their suitability for downstream applications and knowledge graph construction. In this paper, we present a semi-automated soundness assessment workflow for validating structured recipe data extracted and augmented by LLMs from informal culinary sources. Developed as part of FKG(.in), a knowledge graph of Indian food, the pipeline identifies and addresses common failure modes, including structural inconsistencies, semantic and logical incoherence, and deviations from the source text, through a multi-stage process combining formal grammars, vocabulary-based checks, statistical heuristics, Set Transformer-based coherence modeling, and retrieval-based verification. Although evaluated on Indian recipes, the proposed methods are applicable to broader multilingual and multicultural culinary domains. We provide a practical, auditable, and application-agnostic framework for validating LLM-augmented recipe data, thereby strengthening the foundations of machine-readable food knowledge infrastructures in the era of LLM-generated content.
Sources
- DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text Generation
- From Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification
- HALoGEN: Fantastic LLM Hallucinations and Where to Find Them
- NutriBench: A Dataset for Evaluating Large Language Models on Nutrition Estimation from Meal Descriptions
- FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examination
- Fine-tuning Language Models for Recipe Generation: A Comparative Analysis and Benchmark Study
- Towards General Text Embeddings with Multi-stage Contrastive Learning
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems