Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes
The episode discusses a paper testing whether LLM internal activations can measure ESG concept content in text without fine-tuning. A simple linear probe beat concept vectors and matched fine-tuned classifiers, proving activations carry more than model outputs. Hosts highlight cost savings, wrapper sensitivity, and the need for ordinal labels.