Generalization Dynamics of Linear Diffusion Models

Name: Generalization Dynamics of Linear Diffusion Models
Uploaded: 2026-10-04T02:42:36.465207+00:00
Duration: 452 s
Description: The study analyzes how hierarchical data structure affects linear diffusion models' generalization when training data is finite. It identifies two regimes based on sample size versus dimension and shows that regularization and hierarchy influence learning speed and overfitting mitigation, confirming that a more hierarchical covariance spectrum leads to better model fits.

The study analyzes how hierarchical data structure affects linear diffusion models' generalization when training data is finite. It identifies two regimes based on sample size versus dimension and shows that regularization and hierarchy influence learning speed and overfitting mitigation, confirming that a more hierarchical covariance spectrum leads to better model fits.

Open the full episode