Clustering in pure-attention hardmax transformers and its role in sentiment analysis

arXiv:2407.01602 · cs.CL, cs.LG, math.DS, stat.ML · Submitted 2024-06-26 · Read on arXiv

cs.CL, cs.LG, math.DS, stat.ML

Submitted: 2024-06-26

Updated: 2026-11-17

Code: https://github.com/DCN-FAU-AvH/clustering-hardmax-transformers

Terminology

Sources

Related papers