FinDialogLens: Event Extraction over Multi-Party Dialogue for Missed-Trade Identification in Financial Chatrooms
cs.CL, cs.AI
Submitted: 2026-10-01
Updated: 2026-10-01
Comments: Accepted at EMNLP 2026 (Industry Track)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Multi-party financial chatrooms are vital for sales-and-trading professionals, but their complexity makes manual recovery of missed trades infeasible: each Request for Quote (RFQ) is an event whose
Abstract
Multi-party financial chatrooms are vital for sales-and-trading professionals, but their complexity makes manual recovery of missed trades infeasible: each Request for Quote (RFQ) is an event whose final price and trade outcome appear many messages after the RFQ-trigger message (the inquiry message), interleaved with concurrent RFQs from other participants. We cast this as event extraction (EE) over multi-party dialogue and present FinDialogLens, a hybrid LLM pipeline in which compact fine-tuned classifiers act as inference-time scaffolds: they detect RFQ-triggers and price/trade outcome metadata, an RFQ-Level Module segments per-event RFQ windows, and a Trade Engine fills argument roles. With GPT-4o, FinDialogLens reaches 92.1% and 94.3% accuracy on final price and trade outcome, respectively, outperforming full-chatroom CoT prompting methods; fine-tuned open-source LLMs with as few as 3B parameters achieve comparable performance with modest in-domain data. To make the LLM-based solution practical at scale, a difficulty-aware router balances cost and accuracy by allocating RFQs between a low-cost rule-based engine and the higher-performing LLM-powered Trade Engine, cutting LLM calls by 85% on final price while recovering half of the accuracy gap to FinDialogLens (GPT-4o), saving over 300/day at our 70,000-RFQ/day scale.
Sources
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
- A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law
- Scaling Instruction-Finetuned Language Models
- The Llama 3 Herd of Models
- Mistral 7B
- Large Language Models in Finance: A Survey
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
- A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges
- RouteLLM: Learning to Route LLMs with Preference Data
- GPT-4o System Card
- GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction
- FinRED: A Dataset for Relation Extraction in Financial Domain
- Open, Closed, or Small Language Models for Text Classification?
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering