NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling

arXiv:2610.10459 · cs.LG · Submitted 2026-10-07 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom, and with me are Jane, Lu, senior AI researcher at Tsinghua, Meng, lead engineer at a mysterious AI startup and Lalam, the in-house Large Language Model.

Jane: Today's paper: "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling".

Tom: The gist:

Jane: First, who's behind it and why it matters.

Paper summary: Tom: So we talked about what NeuralBES is, and now let’s get into the specifics of how they built this system. The paper "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling" lays out how they parameterize that resistance–capacitance model.

Jane: They start by saying they use a shared neural encoder to read the static building metadata, which includes things like floor area, vintage, and HVAC type. This metadata is then mapped to physically bounded capacitances, conductances, and equipment coefficients.

Lu: The architecture involves a neural encoder that produces both a latent building embedding zb and those building-specific thermal parameters that populate the RC model.

Meng: So the static data isn't just fed into some standard neural network; it’s specifically designed to produce these physically constrained parameters, which is key for making it useful.

Lalam: Each head in their architecture is a two-layer SiLU MLP conditioned on that static embedding zb, and they make sure the final layer has a zero-initialized weight and a bounded activation so that all those capacitances, conductances, capacities, and COPs stay strictly positive and within physically plausible ranges.

Tom: That constraint enforcement sounds like it’s where the physics enforcement comes in for the machine learning part. So they aren't just letting the network learn anything; they are forcing it to respect physical boundaries from the start.

Jane: And then, this time-varying signal wb,t acts as the external forcing on this model, and that air-node balance equation reduces to a scalar linear ODE of a specific form.

Lu: That ODE is written as dTair b dt equals minus P air b,t Cair b Tair b Cair b Tair,eq b,t Pair b,t equals UAinfil b(t) plus h am m b(three).

Meng: So this linear ODE has an exact closed-form solution over a time interval of t to t plus Delta t, which is pretty neat because it means they don't have to rely on numerical integration for the core dynamics.

Lalam: Then they introduce the affine term bair b,t equals (one minus alphaair b,t) Tair,eq b,t puts the update into a familiar state-space form of Tair b,t equals alphaair b t TAir b t−one + bai airb t <ref:2610.10459#pg1>.

Tom: And that’s the setup for solving it in parallel across time using a log-space associative scan. The paper calls this Heinsen log-space reformulation because it avoids underflow by working with cumulative log-decays.

Jane: This parallel scan approach is what allows them to solve the recurrence efficiently, and they do it in adaptively sized chunks to keep things efficient at long horizons without overflowing.

Lu: The coupling between state and actuator is closed through a short fixed-point loop that alternates between estimating the load the thermostat would demand at the current trajectory, clipping that demand by equipment capacity, and then re-integrating the temperature trajectory under that clipped load.

Meng: So this predictor–corrector loop is what finally closes that thermostat–temperature nonlinearity they mentioned earlier, which is a critical piece for making sure their simulation matches real-world control behavior.

Lalam: That whole process, from parameterization to parallel solving to the control loop, shows how NeuralBES manages to keep both the physical structure and the data-driven flexibility together effectively.

Conclusion: Tom: So we’ve covered a lot about NeuralBES today. To wrap up, we looked at how this system works, from parameterizing a building model with a shared neural encoder to solving that linear recurrence in parallel and closing the thermostat nonlinearity with a predictor–corrector loop.

Jane: The authors of "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling" are aiming to show this model can be used widely by grid planners, utility analysts, MPC researchers, and policy modelers who need to simulate large populations of buildings under various conditions.

Lu: The main implication is that they’ve created a differentiable surrogate that scales to millions of buildings, trains once on metadata already available in tax-assessor records and utility rolls.

Meng: So for the practical world, this means you can get physics-valid predictions at scale without needing to perform a massive per-building calibration campaign.

Lalam: And they really highlight that NeuralBES occupies a specific point in the BEM / ML design space by contrasting it against classical methods, trading envelope fidelity for two orders of magnitude fewer required inputs.

Tom: It’s about showing that first principles thermodynamics and scalable neural sequence modeling can share the same forward pass, which is pretty powerful for building trust in these kinds of models.

Jane: And they show that when you combine physical inductive bias with data-driven flexibility, you get something that's accurate to within four MAPE points of the strongest raw-error baseline.

Lu: The future research target they set is about extending the data-driven component so it can absorb phenomena hard to express analytically while keeping the interpretability and generalization properties provided by the physical backbone.

Meng: So essentially, they are pushing toward a system that’s robust enough for complex, real-world scenarios without needing to fundamentally rewrite the governing ODE just to add new physics like multi-zone coupling.

Lalam: That sounds like they are focusing on making the data component smarter enough to handle the hard stuff while keeping that physical backbone intact for interpretability.

Fujitsu Research of America

cs.LG

Submitted: 2026-10-07

Updated: 2026-10-12

Comments: This paper has been withdrawn because it was posted without the required authorization from the authors' employer

License: http://creativecommons.org/licenses/by-nc-nd/4.0/

Importance score: 89/100

The gist: The gist: NeuralBES introduces a differentiable emulator that resolves the tradeoff between high-fidelity physics simulators and scalable data-driven models by parameterizing an RC thermal model with

Key concepts

RC Thermal Model
This is a simplified physical model representing how heat moves through a building's structure. It treats the building as having resistance (like insulation) and capacitance (like stored heat in materials). NeuralBES parameterizes this model using a neural network to learn the specific resistance and capacitance values for different buildings.
Shared Neural Encoder
This is a single neural network that takes static information about a building, such as its floor area or vintage, and converts it into two things: a general building embedding (zb) and specific thermal parameters. This allows the model to generalize knowledge from many buildings while still being tailored to individual characteristics.
Log-Space Associative Scan
This is a highly efficient method used to solve the time-varying thermal dynamics equation in parallel across time steps. It works by processing cumulative log-decays instead of raw numbers, which prevents numerical underflow and allows the calculation to proceed efficiently over long prediction horizons.
Predictor–Corrector Loop
This is a control mechanism used to fix a common problem in thermal modeling: the nonlinear relationship between the thermostat setting (desired temperature) and the actual resulting temperature. The loop estimates what load the thermostat would demand, clips it by equipment limits, and then re-integrates that clipped load to correct the temperature trajectory.

Terminology

Summary

The gist: NeuralBES introduces a differentiable emulator that resolves the tradeoff between high-fidelity physics simulators and scalable data-driven models by parameterizing an RC thermal model with a shared neural encoder and solving the resulting linear recurrence in parallel via a log-space scan, while closing the thermostat–temperature nonlinearity through a predictor–corrector loop.

Problem Addressed

Demand-side flexibility i.e. forecasting, shifting, and curtailing residential energy loads, depends on thermal models trusted across millions of heterogeneous buildings Existing tools force a hard tradeoff: high-fidelity physics simulators such as EnergyPlus are accurate but sequential and require per-building calibration, while purely data-driven sequence models scale but abandon the physical structure that makes their predictions trustworthy. Classical BEM requires per-building calibration of dozens of parameters (wall layers, window properties, HVAC performance curves, infiltration coefficients), which is what gives it accuracy and what prevents it from scaling. Purely data-driven emulators scale but abandon the physical structure that makes their outputs trustworthy under distribution shift (new climates, new control policies, new tariffs), which is precisely the regime where demand-flexibility studies need them most. NeuralBES targets the middle.

NeuralBES Architecture and Parameterization

NeuralBES parameterizes a resistance–capacitance (RC) based thermal model with a shared neural encoder. Static building metadata such as floor area, vintage, and HVAC type is mapped to physically bounded capacitances, conductances, and equipment coefficients. The architecture involves a neural encoder that reads the static descriptor and produces both a latent building embedding zb and a set of building-specific thermal parameters that populate an RC model. Each head (color-coded in Figure 1) is a two-layer SiLU MLP conditioned on the static embedding zb, with a zero-initialized final layer and a bounded activation so that capacitances, conductances, capacities, and COPs remain strictly positive and in physically plausible ranges.

Solving the Thermal Dynamics

The time-varying signal wb,t then acts as the external forcing on this model. The air-node balance in Eq. (1) reduces to a scalar linear ODE of the form dTair b dt = −P air b,t Cair b Tair b − Tair,eq b,t, Pair b,t = UAinfil b(t) + h am b,(3). This ODE admits an exact closed-form solution over [t, t + ∆t], a geometric decay toward the instantaneous equilibrium. Introducing the affine term bair b,t = (1 − αair b,t) Tair,eq b,t puts the update in the familiar state-space form Tair b,t = αair b,t TAir b,t−1 + bai airb,t.

Parallel Computation and Control Loop

The recurrence is solved in parallel across time using a log-space associative scan. The Heinsen log-space reformulation avoids underflow by working with cumulative log-decays. This process is performed in adaptively-sized chunks to prevent overflow and maintains efficiency at long horizons. The coupling between state and actuator is closed through a short fixed-point loop that alternates between estimating the load the thermostat would demand at the current trajectory, clipping that demand by equipment capacity, and re-integrating the temperature trajectory under the clipped load. This predictor–corrector loop closes the thermostat–temperature nonlinearity.

Performance and Comparison

On the annual full-year rollout, NeuralBES is the only data-conditioned model that is simultaneously physics-valid and accurate to within 4 MAPE points of the strongest raw-error baseline. Among physics-valid baselines at parameter parity it more than halves the MAPE of the grey-box RC alternative. NeuralBES achieves 100% mode exclusivity and 99.7 ± 0.1% bounds adherence on the multi-region ResStock test set. The model is roughly an order of magnitude smaller than transformer and recurrent baselines because of its physical inductive bias, not because of architectural tricks.

Limitations

Two limitations frame the next steps. First, NeuralBES resolves only the sensible thermal dynamics of the zone air and building mass and does not explicitly model the domestic hot-water system, which is absent from the heat-balance equation that drives the analytical solver. Second, scalability along the physics axis is bounded by the equations we commit to: adding phenomena such as multi-zone coupling, refrigerant cycles, or stratified storage requires editing the governing ODE rather than widening the network. The more interesting research target going forward is how to extend the data-driven component so that it can absorb phenomena hard to express analytically while keeping the interpretability and generalization properties that the physical backbone provides.

Conclusion

We introduce NeuralBES, a differentiable building-energy emulator that parameterizes a two-node RC thermal model with a shared encoder and solves the resulting linear recurrence in parallel via a logspace associative scan, wrapped in a predictor–corrector loop that closes the thermostat–temperature nonlinearity. On the multi-region ResStock annual-rollout benchmark, NeuralBES is the only dataconditioned model on the Pareto frontier of accuracy and physics validity (100% mode exclusivity, 99.7% bounds adherence across seeds), at roughly an order of magnitude fewer parameters than transformer and recurrent baselines, while substantially outperforming the comparably structured grey-box RC at parameter parity (∼ 41% vs. ∼ 89% MAPE on the HVAC channels). First-principles thermodynamics and scalable neural sequence modeling share the same forward pass. The code, including the script to gather the public dataset, is attached in the supplement materials to reproduce the result. All cited assets are publicly released under their respective open licenses and are used consistently with their terms. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.1) and involves no human subjects, personally identifiable information, or scraped content. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.1) and involves no human subjects, personally identifiable information, or scraped content. The code, including the script to gather the public dataset, is attached in the supplement materials to reproduce the result. All cited assets are publicly released under their respective open licenses and are used consistently with their terms. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.1) and involves no human subjects, personally identifiable information, or scraped content. All cited assets are publicly released under their respective open licenses and are used consistently with their terms. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.1) and involves no human subjects, personally identifiable information, or scraped content. All cited assets are publicly released under their respective open licenses and are used consistently with their terms. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.1) and involves no human subjects, personally identifiable information, or scraped content. All cited assets are publicly released under their respective open licenses and are used consistently with their terms. The work uses only synthetic, simulator-generated building energy traces from the publicly released ResStock corpus (Section 4.

Improvements for AI systems

  1. Better demand-side flexibility via NeuralBES: The system can forecast, shift, and curtail residential energy loads with accuracy to within 4 MAPE points of the strongest raw-error baseline while operating at roughly an order of magnitude fewer parameters than the transformer and recurrent baselines.

  2. Physics-valid generalization: The improved system can handle heterogeneity by mapping static building metadata such as floor area, vintage, and HVAC type is mapped to physically bounded capacitances, conductances, and equipment coefficients, allowing it to function across heterogeneous building archetypes, vintages, and climate zones within a single trained encoder.

  3. Scalable inference: The system can simulate populations of buildings efficiently because the core mechanism is a log-space parallel scan which runs in O(T) work and O(log T) depth via a parallel scan, translating directly into parameter efficiency at long horizons compared to attention-based models that incur O(T 2) compute and memory.

  4. Physics-constrained control: The system can manage real-world operational constraints by using a predictor–corrector loop that closes the thermostat–temperature nonlinearity, ensuring it maintains exclusive heating/cooling modes, bounded indoor temperature, [and] correct sign of HVAC response where purely data-driven baselines collapse to statistically plausible but physically inconsistent trajectories.

Abstract

Demand-side flexibility i.e. forecasting, shifting, and curtailing residential energy loads, depends on thermal models trusted across millions of heterogeneous buildings. Existing tools force a hard tradeoff: high-fidelity physics simulators such as EnergyPlus are accurate but sequential and require per-building calibration, while purely data-driven sequence models scale but abandon the physical structure that makes their predictions trustworthy. We introduce NeuralBES (Building Energy Simulation), a differentiable emulator that resolves this tradeoff by parameterizing a resistance--capacitance (RC) based thermal model with a shared neural encoder: static building metadata such as floor area, vintage, and HVAC type is mapped to physically bounded capacitances, conductances, and equipment coefficients, which become the coefficients of a scalar linear recurrence solved via a log-space parallel scan, and a predictor--corrector loop closes the thermostat--temperature nonlinearity while preserving full-horizon gradient flow. Trained on the ResStock dataset across three climate zones, NeuralBES handles heterogeneous building archetypes, vintages, and climate zones within a single trained encoder, while black-box baselines produce statistically plausible but physically inconsistent trajectories. On the annual full-year rollout, NeuralBES is the only data-conditioned model that is simultaneously physics-valid and accurate to within 4 MAPE points of the strongest raw-error baseline, while operating at roughly an order of magnitude fewer parameters than the transformer and recurrent baselines; among physics-valid baselines at parameter parity it more than halves the MAPE of the grey-box RC alternative.

Sources

Related papers