CivicBench: A Benchmark and Memory Framework for Web-Based Civic Data Analytics
cs.AI
Submitted: 2026-10-31
Updated: 2026-10-31
Terminology
Sources
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks
- CityBench: Evaluating the Capabilities of Large Language Models for Urban Tasks
- Enabling Large Language Models to Generate Text with Citations
- HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
- Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications
- InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks
- Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
- Memory OS of AI Agent
- AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions
- USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agents
- Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
- Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs
- UrbanGPT: Spatio-Temporal Large Language Models
- AgentBench: Evaluating LLMs as Agents
- Evaluating Very Long-Term Conversational Memory of LLM Agents
- GeoLLM: Extracting Geospatial Knowledge from Large Language Models
- GAIA: a benchmark for General AI Assistants
- An Autonomous GIS Agent Framework for Geospatial Data Retrieval
- MemGPT: Towards LLMs as Operating Systems
- Zep: A Temporal Knowledge Graph Architecture for Agent Memory
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents