Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026
cs.CL, eess.AS
Submitted: 2026-08-25
Updated: 2026-09-21
Comments: 3 pages, BeTraC 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: With the advent of Large Language Models and its instruction following capabilities a promising application is the task of summarization.
Terminology
Abstract
With the advent of Large Language Models and its instruction following capabilities a promising application is the task of summarization. Within this domain of task the extractive sub-task of clinical protocolling has emerged as a topic of particular interest as it can significantly reduce the downtime and protocolling burden of health-care workers thus enabling them to focus on their core work helping humans. A further step towards automation is the direct generation of clinical notes from speech without intermediate transcripts, reducing processing time while preserving information such as coughing or other paralinguistic cues that may be lost in transcript-based systems. To this end, we present KIT's submission to this years BeTraC challenge in the lightweight track. Our main contribution is a scalable data augmentation pipeline that unifies heterogeneous medical dialogue datasets through synthetic speech generation and automatically generated SOAP supervision, enabling robust adaptation of a speech foundation model for end-to-end speech-to-SOAP generation.
Sources
- Qwen2.5-Omni Technical Report
- MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
- Efficient Weight factorization for Multilingual Speech Recognition
- LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
- StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
- Averaging Weights Leads to Wider Optima and Better Generalization
- Weight Factorization and Centralization for Continual Learning in Speech Recognition
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering