Neural Networks as Linear Regression: An Introduction for Statisticians
Abigail Loe, Susan Murray, Zhenke Wu
stat.ML, cs.LG
Submitted: 2026-06-22
License: http://creativecommons.org/licenses/by/4.0/
The gist: Neural networks are a commonly used prediction tool in computer science and statistics.
Terminology
Abstract
Neural networks are a commonly used prediction tool in computer science and statistics. However, the barrier to entry of this interesting field remains high, particularly for classical statisticians trained in a frequentist perspective. In this letter, we demystify neural networks by describing networks that approximate a linear regression and describe common customizations that provide a foundation for further study.
Sources
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Scalable Posterior Uncertainty for Flexible Density-Based Clustering
- A Transport Geometry of Benign Overfitting
- Efficient quadratic entropy with distance sketches