Error-Based Bidirectional Predictive Coding Enables Deep, 4-Bit Predictive Coding Networks
The paper introduces ePC+bPC, combining bidirectional predictive coding and error-based reparameterization to create deep predictive coding networks that work well at 4-bit precision. This method overcomes signal decay and error instability issues found in standard models, allowing networks to train up to eight layers while maintaining high accuracy and generation capabilities under quantization.