Beyond Decodability: Reconstructing Language Model Representations with an Encoding Probe
The episode discusses the paper "Beyond Decodability," which uses an Encoding Probe to analyze AI language models. The research reveals that different types of knowledge, such as syntax and lexicon, are stored separately within the model. This discovery demonstrates modularity and allows for building measurable, accountable AI systems that move beyond black boxes.