Understanding Affective Adaptation in Multimodal Foundation Models: Emergent Functional Specialization
The study investigated where emotion-oriented training affects large foundation models. It found that affective adaptation primarily occurs in the feed-forward network's gating projection, not in the attention mechanism. This localization suggests that emotional modeling relies on selectively modulating features rather than reorganizing global information, leading to an efficient tuning strategy.