Towards Financial World Modeling
The study explored various self-supervised methods to create a useful state representation for financial markets using a massive dataset of one trillion observations. Researchers found that different representation learning strategies capture distinct aspects of market organization, and no single quality metric captures everything needed for good forecasting. A robust financial state must preserve more than just next-return prediction.