Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting
summary
The gist
High-frequency volatility forecasting typically separates measurement from prediction: intraday observations are first compressed into a daily realized measure using a fixed aggregation rule…
In short
The paper introduces Neural Realized Measures (NRM), a framework that improves volatility forecasting by intelligently aggregating intraday market data. Instead of using fixed averaging, NRM learns context-dependent weights to combine different time points, preserving original data contributions while optimizing predictions.
Key concepts
- Neural Realized Measures (NRM)
- NRM is a method that aggregates high-frequency intraday price movements by learning optimal, positive weights for each contribution. It keeps the original data structure intact while replacing simple uniform averaging with weights that adapt based on the specific forecasting task.
- Primitive Preservation
- This concept means NRM keeps the fundamental, statistically defined building blocks (primitives) of volatility measures unchanged. The learning process only focuses on how these fixed primitives should be combined together, rather than redefining what the underlying measure itself is.
- Forecast-Supervised Aggregation
- The aggregation weights and model parameters are learned by training the system to minimize prediction errors (the loss). This means the aggregation method is guided directly by the goal of making accurate volatility forecasts, linking data processing directly to predictive performance.
Terminology used across episodes
This episode discusses
- Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting · Paper Radio
- HARNet: A Convolutional Neural Network for Realized Volatility Forecasting
The paper
Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting · Read on arXiv
Brian Sing Fan Chan, Jennifer So Kuen Chan
University of Sydney
High-frequency volatility forecasting typically separates measurement from prediction: intraday observations are first compressed into a daily realized measure using a fixed aggregation rule, and the resulting statistic is then passed to a forecasting model. This conventional pipeline therefore treats measure construction as forecast-agnostic preprocessing. We ask whether the aggregation stage itself can instead be learned from the downstream forecasting objective while preserving the statistical structure of established realized measures. We propose Neural Realized Measures (NRM), a primitive-preserving, forecast-supervised aggregation framework that retains the original measure-specific intraday contributions but replaces uniform aggregation with positive, mean-normalized context-dependent weights. Uniform weights exactly recover the corresponding raw realized measure (RRM), so the classical construction is nested as a special case. Because NRM remains an explicit weighted sum of established primitive contributions, it also retains direct bar-level attribution. Across SF, HAR, and MIDAS forecasting specifications, NRM is evaluated against corresponding RRM specifications under controlled comparisons. In Heston simulations, NRM reduces RMSE for both contemporaneous and next-day latent integrated variance across all evaluated primitive--regime combinations. On six cryptocurrencies using five-minute data, NRM improves QLIKE in all 54 paired out-of-sample comparisons, with mean gains of 7.23%, 8.15%, and 9.22% under SF, HAR, and MIDAS, respectively. Validation-selected NRM specifications also achieve the lowest mean QLIKE across the six assets among the evaluated approaches. Ablation and SHAP analyses reveal systematic time-of-day and nonlinear local-context effects in the learned allocation.
Transcript
Introduction to the show: ident: Quantitative Finance. The day in quantitative finance: models of markets, risk and prices.
Ruth: We're looking at the paper: "Neural Realized Measures".
Warren: Here's the gist of the paper. High-frequency volatility forecasting typically separates measurement from prediction: intraday observations are first compressed into a daily realized measure using a fixed aggregation rule, and the resulting statistic is then passed to a forecasting model The Core Proposal The paper proposes Neural Realized Measures (NRM), which is a primitive-preserving, forecast-supervised aggregation framework that retains the original measure-specific intraday contributions but replaces uniform aggregation with positive, mean-normalized context-dependent weights NRM is a primitive-preserving, forecast-supervised aggregation framework that retains the original measure-specific intraday contributions but replaces uniform aggregation with positive, mean-normalized context-dependent weights <ref:2611.07287#pg4>.
Ruth: Uniform weights exactly recover the corresponding raw realized measure (RRM), so the classical construction is nested as a special case <ref:2611.07287#pg5>.
Warren: Because NRM remains an explicit weighted sum of established primitive contributions, it also retains direct bar-level attribution <ref:2611.07287#pg4>.
Ruth: Primitive Preservation and Structure NRM is built upon the concept of retaining the statistically defined primitive and making only its aggregation task-adaptive <ref:2611.07287#pg4>.
Paper summary: Ruth: We just talked about how this paper, Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting, suggests that instead of treating measurement as a fixed step before forecasting, we can learn the aggregation weights directly from the forecast objective >
Warren: The core proposal is NRM. It's a primitive preserving framework that keeps the original measure specific contributions but uses context dependent positive weights to replace uniform aggregation >
Iris: They show that uniform weights perfectly recover the raw realized measure, which they call RRM, so the classical construction is just a special case of this framework >
Ruth: So the authors are saying they can learn these weights by training a neural network where the loss function penalizes the average daily divergence between their forecast and what actually occurred >
Warren: And to keep things honest, they include a KL to uniform regularization term, which specifically punishes deviations from that classical uniform aggregation benchmark >
Iris: The structure they are building is important because it keeps the primitive fixed—that core measurement concept doesn't change—but only the aggregation weights learn based on the downstream task >
Ruth: This puts NRM in a structured middle ground between traditional econometric measurement and pure end-to-end neural representation learning >
Warren: It’s not just throwing away the old measure for some black box representation, it's adapting how that measure is summarized for forecasting >
Iris: And because the primitive contribution remains explicit, this framework allows for a direct interpretation of which bar level gets which weight in the final measure >
Ruth: That means we can actually examine what's driving the learned allocation rather than just looking at some abstract latent feature vector >
Conclusion: Warren: So to wrap up, this paper, Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting, offers a way to learn the aggregation structure directly from forecasting objectives while maintaining the statistical integrity of realized measures >
Iris: The authors show that by using positive mean normalized context dependent weights instead of uniform ones, they can achieve better forecast performance in various volatility regimes across different assets >
Ruth: The implication is that for high frequency volatility forecasting, this isn't about completely abandoning the measure construction pipeline, but making it task specific >
Warren: It provides a structured alternative to both just using fixed realized measure aggregation and totally unrestricted end-to-end neural forecasting methods >
Iris: The paper notes that while they found improvements, the method is forecast specificationspecific, so it's better viewed as a representation tailored for that task rather than something universal >
Ruth: And they also flag some boundaries. For instance, the cryptocurrency setting provides consistent twenty-four hour UTC days but doesn't generalize well to markets with sessions or overnight gaps > <ref:2611.07287#pg1>
Warren: Plus, the simulation regimes are controlled stresses instead of fully calibrated microstructure models, and it excludes richer volume and order book information >
More episodes
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- The day in conversation for 2026-11-18
- Daily Summary for 2026-11-18
- 2601.05274-On the use of case estimate and transactional payment data in neural networks for individual loss reserving
- 2009.00868-Loss-Given-Default Modeling by Post-Last Passage Time Process
- 2606.30070-Financial Resilience Evaluation: From Conditional Expectations to Dynamic Convex Risk Measures
- 2212.12687-Measuring price impact and information content of trades in a time-varying setting
- Daily Summary for 2026-11-17
- 2401.08323-Dynamic portfolio selection under generalized disappointment aversion