Are We Really Making Much Progress in Text Classification? A Comparative Review
This review compares various methods for text classification, including bag-of-words and different transformer models. It finds that fine-tuned encoder-only transformers are currently the best performers, outperforming complex graph methods. The authors recommend using strong baselines and task-specific fine-tuning for reliable results.