Just Pass Twice: Efficient Token Classification with LLMs for Zero-Shot NER
The episode discusses 'Just Pass Twice,' a paper presenting an efficient method for Named Entity Recognition (NER) using Large Language Models. The technique solves limitations in LLM causal attention by duplicating input sequences, allowing future context to flow back into the first pass. This results in significant F1 score increases and 20x faster performance than generative methods.