Thinking in Depth: Retrospective Inference for Tabular Foundation Models
RETRO introduces a tabular foundation model that uses retrospective inference to revisit and combine intermediate information from earlier layers. This allows for earlier and more distributed prediction refinement across the network depth, shifting predictive improvement away from just later stages.