MegaMem: A Retrieval Solution for Ultra-Large Context Windows
MegaMem introduces a source-resolved dual-view retrieval system to handle ultra-large persistent memory while keeping the information used for generating answers bounded. It separates semantic access from generation evidence by indexing both detailed original chunks and compact distilled summaries of those chunks. This allows systems to search massive datasets efficiently without increasing the context size needed for the final answer.