DeltaNet-PC: Test-Time Memory Without Backpropagation Through Time
DeltaNet-PC develops a predictive coding system that learns to memorize sequential information during testing without needing backpropagation through time. It treats per-step memory updates as latent variables, enabling test-time verbatim memorization of single sequences, multiple sequences, and key-value pairs with high accuracy.