LifePlanner: Evaluating LLM Agents for Geo-spatial Planning with Social Media Data

arXiv:2608.25039 · cs.AI · Submitted 2026-08-25 · Read on arXiv

cs.AI

Submitted: 2026-08-25

Updated: 2026-08-25

Comments: 25 pages, 7 figures, 11 tables

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 27× in this paper · explained in 2 episodes
• Data Engine Agent — 9× in this paper
• Grounding — 9× in this paper · explained in 3 episodes
• Pass Rate — 9× in this paper
• Reasoning Purity — 8× in this paper
• Verification — 8× in this paper · explained in 2 episodes
• Consistency — 7× in this paper · explained in 3 episodes
• Accuracy — 6× in this paper · explained in 1 episode
• Benchmarking — 6× in this paper · explained in 3 episodes
• Core — 5× in this paper · explained in 2 episodes
• Hallucination — 5× in this paper · explained in 3 episodes
• RAG — 5× in this paper · explained in 3 episodes
• Tool Efficiency — 5× in this paper
• Information Grounding — 4× in this paper
• Calibration — 3× in this paper · explained in 7 episodes
• Order Consistency — 3× in this paper
• Routing Deviation — 3× in this paper
• Semantic Constraint Satisfaction — 3× in this paper
• Aggregation — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper · explained in 1 episode
• Attribute Accuracy — 2× in this paper
• Foundation Model — 2× in this paper · explained in 3 episodes
• Foundation Models — 2× in this paper · explained in 7 episodes
• LLM judge — 2× in this paper · explained in 2 episodes
• Multi-hop Reasoning — 2× in this paper · explained in 3 episodes
• Redundancy — 2× in this paper · explained in 2 episodes
• Trace — 2× in this paper · explained in 2 episodes
• Agentic System — 1× in this paper · explained in 2 episodes
• Computational overhead — 1× in this paper · explained in 2 episodes
• Distillation — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Ontology — 1× in this paper · explained in 2 episodes
• Reasoning Traces — 1× in this paper · explained in 3 episodes
• Structured Reasoning — 1× in this paper · explained in 3 episodes
• Synthetic Data Generation — 1× in this paper · explained in 5 episodes

Sources

• Retrieval-Augmented Generation for Large Language Models: A Survey
• GLM-5: from Vibe Coding to Agentic Engineering
• SpatialLLM: From Multi-modality Data to Urban Spatial Intelligence
• Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
• USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agents
• LocalGPT: Benchmarking and Advancing Large Language Models for Local Life Services in Meituan
• Urban-R1: Reinforced MLLMs Mitigate Geospatial Biases for Urban General Intelligence
• TALM: Tool Augmented Language Models
• COMPASS: Benchmarking Constrained Optimization in LLM Agents
• Spatial-RAG: Spatial Retrieval Augmented Generation for Real-World Geospatial Reasoning Questions
• TripScore: Aligning LLMs for Real-World Travel Planning via Expert-Calibrated Reward
• DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints
• ChinaTravel: An Open-Ended Travel Planning Benchmark with Compositional Constraint Validation for Language Agents
• Constraint-Aware Route Recommendation from Natural Language via Hierarchical LLM Agents
• MobilityBench: A Benchmark for Evaluating Route-Planning Agents in Real-World Mobility Scenarios

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• Agents' Last Exam
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems