MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
The episode discusses 'MixLoRA-DSI,' a method for generative retrieval over dynamic data. Hosts explain how it enables continuous, rehearsal-free learning by intelligently expanding model experts only when new information is genuinely Out Of Distribution, making large-scale AI systems more efficient and practical.