A Multimodal Emotion Recognition System: Integrating Facial Expressions, Body Movement, Speech, and Spoken Language
A multimodal system was developed to improve psychological evaluation by combining facial expressions, body movements, speech emotion recognition, and text analysis of spoken language. While individual models performed well alone, fusing these different data sources resulted in a significantly more accurate overall prediction (96.43%), proving that combining multiple cues makes the tool much more robust for real-world use.