Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Tasks
The 'Bactrainus' paper introduces a two-stage architecture designed for multi-hop question answering. By separating the process into a document selector and a reasoning reader, researchers demonstrated that fine-tuned open-source models can outperform massive closed-source models like GPT-4o on complex, structured reasoning tasks using the HotpotQA dataset.