Towards Subject-Oriented Video Captioning via User-Specified Targets
The paper introduces Subject-Oriented Video Captioning (SOVCNet) to allow users to specify a target entity using a bounding box, moving beyond general video descriptions. SOVCNet uses subject-oriented sampling and encoding modules to focus the model on the subject's activities, achieving superior performance on new datasets compared to existing methods.