MoRFI: Monotonic Sparse Autoencoder Feature Identification
The discussion of 'MoRFI: Monotonic Sparse Autoencoder Feature Identification' explores a method for identifying internal model features responsible for hallucinations after fine-tuning. The hosts conclude that these features act as gatekeepers to existing knowledge, and restoring accuracy by steering a single feature offers a path toward more reliable AI systems.