Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
The episode discusses 'Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories,' a method for auditing video training data. The technique uses Cumulative Sample Loss (CSL) to diagnose annotation errors by tracking how consistently a model struggles with specific frames over time, proving data quality rather than assuming it.