When More Documents Hurt RAG: Measuring and Reducing Vector Search Dilution with Domain-Scoped Retrieval
Scaling Retrieval-Augmented Generation (RAG) to large, diverse documents causes 'vector search dilution,' where dense similarity fails, leading to contextually incorrect results. The solution introduced is MASDR-RAG, which uses domain scoping based on organizational metadata to restrict searches. This scoping significantly improves retrieval precision across various data sources compared to standard methods.