ChartHal: A Fine-grained Framework Evaluating Hallucination of Large Vision Language Models in Chart Understanding
cs.CV, cs.AI, cs.CL
Submitted: 2025-09-22
Updated: 2026-11-07
Code: https://github.com/ymcui/ChartHal
Terminology
Sources
- GPT-4 Technical Report
- Qwen2.5-VL Technical Report
- Hallucination of Multimodal Large Language Models: A Survey
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
- Gemini: A Family of Highly Capable Multimodal Models
- GPT-4o System Card
- FigureQA: An Annotated Figure Dataset for Visual Reasoning
- Why Language Models Hallucinate
- ChartCap: Mitigating Hallucination of Dense Chart Captioning
- InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic Charts
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
- ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering
- LongHalQA: Long-Context Hallucination Evaluation for MultiModal Large Language Models
- Object Hallucination in Image Captioning
- Rethinking Comprehensive Benchmark for Chart Understanding: A Perspective from Scientific Literature
- ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models
- Evaluation and Analysis of Hallucination in Large Vision-Language Models
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs