FinRank: An Evidence-Grounded Benchmark for Financial Question Answering and Retrieval over SEC Filings
The episode reviews FinRank, a benchmark for financial question answering over SEC filings that prioritizes evidence grounding over answer correctness. Hosts discuss how systems often retrieve correct-looking answers from wrong filings, cite results like BM25 improving from 32% to 55% recall with metadata filtering, and emphasize provenance as critical for audit and compliance.