Single State Update Predictive Coding training for Time Series Forecasting and Anomaly Detection
cs.LG, cs.NE
Submitted: 2026-08-25
Updated: 2026-08-25
License: http://creativecommons.org/licenses/by/4.0/
The gist: Predictive Coding (PC) is a neural learning paradigm that enables parallelizable neural network layer updates.
Terminology
Abstract
Predictive Coding (PC) is a neural learning paradigm that enables parallelizable neural network layer updates. However, the main bottleneck of PC Networks (PCN) is the sequential backwards error propagation. To tackle this, we introduce a training technique that pairs a Generative PCN with a support Encoding PCN. The two PCNs are trained in parallel to match their neural activations, without sequential propagation. We apply this to time series anomaly detection and show that our approach results in more stable, continuous, online learning.
Sources
- Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
- Benchmarking Predictive Coding Networks -- Made Simple
- Predictive Coding Networks and Inference Learning: Tutorial and Survey
- ePC: Fast and Deep Predictive Coding in Digital Simulation
- Faster Predictive Coding Networks via Better Initialization
- Accelerated Predictive Coding Networks via Direct Kolen-Pollack Feedback Alignment
- Closed-form predictive coding via hierarchical Gaussian filters
- Understanding and Improving Optimization in Predictive Coding Networks
- A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks
- Teacher-Student Architecture for Knowledge Learning: A Survey
- Adam: A Method for Stochastic Optimization
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks