Similarity-Distance-Magnitude Activations

The SIMILARITY-DISTANCEMAGNITUDE (SDM) activation function replaces standard softmax to decompose epistemic uncertainty into three interpretable signals: SIMILARITY (training match), DISTANCE (distribution novelty), and MAGNITUDE (decision boundary). This provides a robust alternative for selective classification, enhancing accuracy control and improving robustness against out-of-distribution data.

Open the full episode

More from AI Radio