Linear Classifier: An Often-Forgotten Baseline for Text Classification
The paper argues that using simple linear classifiers with bag-of-words features as a baseline alongside advanced models like BERT is crucial for text classification. While BERT can sometimes perform poorly directly, baselines confirm if advanced results are acceptable. Linear methods offer competitive performance, high efficiency, and robustness compared to resource-intensive deep learning models.