Same-Number Citation Swaps: Stress-Testing Jev as a Financial Evidence Judge
cs.CL
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: counterfactual citation perturbation, evidence attribution verification, financial document question answering, Jev, LLM-as-a-judge, probabilistic source verification, tabular numerical reasoning
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- FinanceBench: A New Benchmark for Financial Question Answering
- Improved LLM Agents for Financial Document Question Answering
- JEV-as-a-Judge: Accept When Confident, Escalate When Unsure
- BudgetVerify: Budget-Tiered Verification for Financial QA
- Type-Safe Is Not Error-Free: Typed Decision Models Follow the Option Name, Not the Definition Bound to It
- VeriFin: A Neurosymbolic Framework for Verifying LLM-Generated Financial Claims
- FinRank: An Evidence-Grounded Benchmark for Financial Question Answering and Retrieval over SEC Filings
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering