Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.
Kai: We're looking at the paper: "Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models".
Mira: Here's the gist of the paper. Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models introduces Gradient-Based Free Energy Surface Optimization (GBFESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable surrogate for the ensemble distribution <ref:2607.06421#pg2>.
Kai: This method optimizes the conditioning variables defining the system so that the generated ensemble reproduces a prescribed target free-energy surface <ref:2607.06421#pg4>.
Mira: Pruning redundant reasoning tokens The core idea of GBFESO is to treat a trained conditional diffusion model as a differentiable surrogate for the ensemble distribution <ref:2607.06421#pg2>.
Kai: After training, the diffusion model is frozen, and the conditioning variables defining the system are optimized so that the generated ensemble reproduces a prescribed target free-energy surface <ref:2607.06421#pg4>.
Paper summary: Kai: Thinking about the title Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models, it really captures how they’ve connected free energy surfaces, which govern state populations and transition barriers, with diffusion models for design. It’s about using a generative model to navigate that landscape.
Mira: I agree. What this work points toward is the shift from optimizing a single structure to controlling the entire statistical ensemble of conformations two <ref:2607.06421#pg2>. They are showing how you can use deep learning surrogates to guide that control process through backpropagation on distribution losses like KL divergence six.
Lev: From my perspective in error correction, the fact that they are optimizing parameters governing the full ensemble means you’re designing for robustness across a whole set of possibilities, not just one specific configuration two <ref:2607.06421#pg2>. It’s about designing systems that behave correctly even when perturbed.
Kai: So, it’s less about hitting one target structure perfectly and more about steering the underlying probability distribution toward the desired free energy surface using the learned mapping from the diffusion model three <ref:2607.06421#pg3>. That ability to extrapolate beyond training data is significant, showing it can generalize its design capability.
Mira: And while they are making progress on this framework, they’re also highlighting that for very large systems, we might need different distributional objectives than KL divergence to maintain scalability and robustness four. So the future direction looks like exploring those alternatives to keep this method practical for bigger things.
Lev: Exactly. The authors themselves noted that improving scalability and robustness in higher-dimensional settings will require alternative distributional objectives, such as Wasserstein-based metrics, to really push this beyond toy systems four. That’s a clear path forward for the next generation of molecular design tools.
Conclusion: Kai: So, this paper is about using gradient methods to design free energy landscapes for systems instead of just looking at one specific structure, right?
Mira: Yeah, basically they took a diffusion model and trained it to be like a map that tells you how to change the system parameters to get the free energy surface you want.
Kai: It’s about this gradient-based inverse design thing where you’re backpropagating through the diffusion sampling trajectory using a distribution loss, which is like, minimizing how much the generated ensemble differs from your target ensemble.
Mira: The authors are showing that even if you're not training on a specific protein structure, but on an entire collection of state ensembles across many different systems, you can still optimize those underlying design variables.
Kai: They did this on a four-bead system, and it worked pretty well for reproducing target landscapes in most test cases, even when the parameters you were tuning were outside what the model had seen before.
Mira: That's interesting because they’re using these complex neural networks to do something fundamentally thermodynamic—designing the energy landscape itself.
Kai: It suggests this conditional diffusion model approach could be a practical way to guide molecular or materials design by controlling the statistical properties of the output ensemble, not just picking one good structure.
Mira: But they also admit there are challenges, especially with very large networks where you might need different ways to measure that distributional agreement than just using the standard Kullback–Leibler divergence.
Kai: So it’s a promising first step for differentiable free energy surface design, but we still have to figure out how efficient this runs when we scale up to truly massive systems.
Mira: Exactly. That leads us into how they handled the specific setup of their four-bead system and what that tells us about the complexity of these models in practice.
Eli Zick, Dan Mendels
Wolfson Department of Chemical Engineering, Technion – Israel Institute of Technology
physics.comp-ph
Submitted: 2026-07-07
Updated: 2026-11-15
Code: https://github.com/MendelsResearchGroup/Gradient-Based-Free-Energy-Surface-Optimization
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 99/100
The gist: Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models introduces Gradient-Based Free Energy Surface Optimization (GBFESO)…
Key concepts
- Gradient-Based Free Energy Surface Optimization (GBFESO)
- This is an inverse design framework that treats a trained diffusion model as a differentiable tool. Instead of designing single structures, it optimizes the input conditions that govern the entire ensemble distribution to match a desired target free-energy surface.
- Conditional Diffusion Model
- A trained diffusion model acts as a differentiable mapping. It takes system-defining properties (the condition 'c') and generates an ensemble of samples that collectively define the corresponding free-energy surface, allowing the optimization process to be guided by this generative capability.
- Ensemble-Level Objective
- The method optimizes based on how well the generated ensemble matches a target distribution, not just individual conformations. This agreement is measured using metrics like Kullback–Leibler (KL) divergence, which quantifies the difference between two probability distributions.
Terminology
Summary
Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models introduces Gradient-Based Free Energy Surface Optimization (GBFESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable surrogate for the ensemble distribution <ref:2607. p. 0 Gradient-Based Inverse Design of Free-Energy Landscapes with Diffusion Models
Eli Zick1 and Dan Mendels1, ∗
1The Wolfson Department of Chemical Engineering,
Technion – Israel Institute of Technology, Haifa 32000, Israel
(Dated: July 8, 2026)
Free-energy surfaces govern the populations of metastable states and the barriers that control
transitions between them, making their direct optimization a central challenge in molecular and
materials design. In this work, we introduce Gradient-Based Free Energy Surface Optimization (GBFESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable
surrogate for the ensemble distribution. In this work, we introduce Gradient-Based Free Energy Surface Optimization (GBFESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable
surrogate for the ensemble distribution. After training, the diffusion model is frozen, and the
conditioning variables defining the system are optimized so that the generated ensemble reproduces
a prescribed target free-energy surface.Where the paper says it
Where the paper says it
Pruning redundant reasoning tokens
The core idea of GBFESO is to treat a trained conditional diffusion model as a differentiable surrogate for the ensemble distribution <ref:2607.06421#pg2>. After training, the diffusion model is frozen, and the conditioning variables defining the system are optimized so that the generated ensemble reproduces a prescribed target free-energy surface <ref:2607. p. 0 In this work, we introduce Gradient-Based Free Energy Surface Optimization (GBFESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable
surrogate for the ensemble distribution. After training, the diffusion model is frozen, and the
conditioning variables defining the system are optimized so that the generated ensemble reproduces
a prescribed target free-energy surface. After training, the diffusion model is frozen, and the
conditioning variables defining the system are optimized so that the generated ensemble reproduces
a prescribed target free-energy surface. The optimization is carried out by backpropagating a
distribution-level loss, based on kernel density estimates of the Kullback–Leibler divergence, through
a deterministic diffusion sampling trajectory. This shifts the inverse-design problem from
targeting individual configurations such as a protein’s
native state to tuning the parameters that govern the full
conformational ensemble. Such an approach is particularly relevant because the
behavior of many physical systems, including proteins,
arXiv:2607.Where the paper says it
Where the paper says it
Where the paper says it
How the training signal is built
The conditional diffusion model serves as a differentiable mapping from a design condition c, representing a set of system-defining properties, to an ensemble of samples that collectively define the corresponding FES <ref:2607.06421#pg3>. The model is trained on a collection of state (conformational) ensembles spanning a diverse set of systems within the domain of interest <ref:2607. p. 1 After training on a collection of state (conformational) ensembles
spanning a diverse set of systems within the domain of
interest, the parameters of the generative neural network
are frozen. At this stage, the conditional diffusion model
is no longer used only to sample ensembles for a prescribed condition; instead, it is treated as a differentiable
surrogate for the condition-dependent ensemble distribution. The training at
each diffusion step is important also because the amount of
corruption varies across the diffusion trajectory, requiring
the model to adapt its denoising behavior at different noise
levels. In practice, training is commonly performed using
a simple mean-squared error objective on the predicted
noise [7, 29]:
MSE = 1
n
Xn
i=1
(yi − yˆi)
2
(5)Where the paper says it
Where the paper says it
Where the gains come from
The optimization is driven by an ensemble-level objective rather than by agreement between individual generated and target conformations <ref:2607.06421#pg4>. The required quantitative metric for this comparison is the Kullback–Leibler (KL) divergence, which can be approximated with Gaussian kernel density estimation (KDE) to form a differentiable loss <ref:2607. p. 2 A natural and widely
used choice is the Kullback–Leibler (KL) divergence[30]:
DKL(P ∥ Q) = Z
p(x) log p(x)
q(x)
dx. (6)
Without an explicit analytic form for the generated
distribution, the KL divergence can be approximated
with Gaussian kernel density estimation (KDE)[31], and
can be written as a differentiable loss:
DKL(ˆptarget ∥ pˆgen) ≈
1
N
X
N
j=1
log pˆtarget(xj )
pˆgen(xj )
,
xj ∼ pˆtarget. (7)
Here
log p(x) ≈ log ˆp(x)
= log"
1
N
X
N
i=1
1
(2π)
d/2h
d
× exp
−
∥x − xi∥
2
2h
2
,
(8)
and h is a bandwidth of the KDE. Given an input condition c, the final optimization objective can be written
as
c
∗ = arg min
c∈C h
DKL(ˆptarget(x) ∥ pˆDDPM(x | c))
+ λDKL(ˆpDDPM(x | c) ∥ pˆtarget(x))i
,
(9)Where the paper says it
Where the paper says it
The method has been validated on one-dimensional Gaussian ensembles, demonstrating that both continuous and relaxed discrete conditioning variables can be optimized to recover target distributions, including those outside the training domain <ref:2607.06421#pg4>. For a four-particle Lennard–Jones toy peptide, GB-FESO successfully optimizes the interaction parameters to reproduce target free-energy landscapes in the majority of test cases <ref:2607. p. 0 We
then apply the method to a four-particle Lennard–Jones toy peptide exhibiting multiple metastable
conformational states. In this more physically motivated setting, GB-FESO successfully optimizes the
interaction parameters to reproduce target free-energy landscapes in the majority of test cases, with
optimization performed either in the full internal-coordinate space or in a reduced collective-variable
representation. Discrete conditioning variables, however, are not differentiable and therefore require a continuous relaxation
during optimization. One possible approach is binary
logit relaxation[36], although several alternative methods
for handling discrete variables have been proposed, including the Straight-Through Estimator (STE)[37] and
the Gumbel–Softmax relaxation[38, 39].Where the paper says it
Where the paper says it
The success in the toy peptide study showed that optimization can be performed in either the full internal-coordinate space or in a reduced collective-variable representation, such as using Harmonic Linear Discriminant Analysis (HLDA) <ref:2607.06421#pg6>. This reduced space approach was found to substantially mitigate computational demands for larger systems <ref:2607. p. 7 Moreover, the KDE-based approximation of the KL
divergence objective can give rise to a rough optimization landscape, hindering convergence. As shown in this
work, however, performing free-energy optimization in
a reduced space of collective variables obtained through
dimensionality-reduction methods, such as HLDA, can
substantially mitigate these issues. In this more physically motivated setting, the method successfully optimizes
the interaction strengths to reproduce target free-energy
surfaces in the large majority of test cases, including
targets whose conditioning parameters lie outside the
training region of the diffusion model. These results suggest that conditional diffusion models provide a practical route for ensemble-level molecular
and materials design, particularly in settings where the
desired outcome is naturally expressed as a distribution
rather than as a single optimized structure. In this more physically motivated setting, the method successfully optimizes
the interaction strengths to reproduce target free-energy
surfaces in the large majority of test cases, including
targets whose conditioning parameters lie outside the
training region of the diffusion model. These results suggest that conditional diffusion models provide a practical route for ensemble-level molecular
and materials design, particularly in settings where the
desired outcome is naturally expressed as a distribution
rather than as a single optimized structure.Where the paper says it
Where the paper says it
Where the paper says it
The paper concludes that optimizing the conditioning variables of a frozen generative model can effectively steer generated ensembles toward target thermodynamic behavior and target free-energy landscapes <ref:2607.06421#pg4>. The framework represents a promising first step toward differentiable free-energy-surface design <ref:2607. p. 7 Furthermore, improving scalability and robustness in higher-dimensional settings may require alternative distributional objectives,
such as Wasserstein-based metrics [46]. Overall, the proposed framework represents a promising first step toward differentiable free-energy-surface
design. For very large neural networks and/or
high-dimensional free-energy landscapes, straightforward
backpropagation through the diffusion sampling trajectory may become computationally inefficient or unstable. Moreover, the KDE-based approximation of the KL
divergence objective can give rise to a rough optimization landscape, hindering convergence.Where the paper says it
Where the paper says it
The authors note that performing free-energy optimization in a reduced space of collective variables obtained through dimensionality-reduction methods, such as HLDA, can substantially mitigate these issues <ref:2607.06421#pg6>. Furthermore, improving scalability and robustness in higher-dimensional settings may require alternative distributional objectives, such as Wasserstein-based metrics <ref:2607. p. 7 As shown in this
work, however, performing free-energy optimization in
a reduced space of collective variables obtained through
dimensionality-reduction methods, such as HLDA, can
substantially mitigate these issues. Furthermore, improving scalability and robustness in higher-dimensional settings may require alternative distributional objectives,
such as Wasserstein-based metrics [46]. Thus, the optimized condition is
evaluated according to the final KL loss between the
generated and target internal-coordinate ensembles. DATA AVAILABILITY
The code and the dataset scripts used to
generate and analyze the data supporting
this article are openly available in Zenodo at
https://doi. DATA AVAILABILITY
The code and the dataset scripts used to
generate and analyze the data supporting
this article are openly available in Zenodo at
https://doi. 5281/zenodo. This shifts the inverse-design problem from
targeting individual configurations such as a protein’s
native state to tuning the parameters that govern the full
conformational ensemble. Such an approach is particularly relevant because the
behavior of many physical systems, including proteins,
arXiv:2607. 5281/zenodo. The
development version of the code is available on GitHub
at https://github. The
development version of the code is available on GitHub
at https://github. com/MendelsResearchGroup/
Gradient-Based-Free-Energy-Surface-Optimization
and is released under the MIT License. com/MendelsResearchGroup/
Gradient-Based-Free-Energy-Surface-Optimization
and is released under the MIT License. ACKNOWLEDGMENTS
The authors acknowledge support from the Israel Science Foundation (ISF) under grant number 1181/24. This shifts the inverse-design problem from
targeting individual configurations such as a protein’s
native state to tuning the parameters that govern the full
conformational ensemble. Such an approach is particularly relevant because the
behavior of many physical systems, including proteins,
arXiv:2607. This shifts the inverse-design problem from
targeting individual configurations such as a protein’s
native state to tuning the parameters that govern the full
conformational ensemble. Such an approach is particularly relevant because the
behavior of many physical systems, including proteins,
arXiv:2607.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
--- Page 9 ---
9
The resulting dump files were postprocessed into internal coordinates rather than Cartesian coordinates <ref:2607. p. 7 The simulations were performed in reduced Lennard–
Jones units with Langevin dynamics at low temperature
t = 0. The resulting dump files were postprocessed into
internal coordinates rather than Cartesian coordinates. The resulting dump files were postprocessed into
internal coordinates rather than Cartesian coordinates. For every saved frame, the target vector was
x = (r12, r23, r34, θ123, θ234), The corresponding (ε1, ε2) values were extracted directly from the
LAMMPS pair coefficients and used as the conditioning
variables. Toy-peptide DDPM and inverse optimization
Within this representation, the model therefore learns
a conditional ensemble distribution
pθ(x | ε1, ε2),
where changes in the condition correspond to changes
in the interaction parameters that define the four-bead
system.Where the paper says it
Where the paper says it
Where the paper says it
--- Page 10 ---
10
The optimization is performed in two stages. In the first stage, the condition is optimized with a relatively large learning rate while stochastic perturbations are added to help escape local minima <ref:2607. p. 8 Optimization is performed in two stages. In the first
stage, the condition is optimized with a relatively large
learning rate while stochastic perturbations are added to
help escape local minima. In the first
stage, the condition is optimized with a relatively large
learning rate while stochastic perturbations are added to
help escape local minima. In the second stage, if the KL
loss remains above a chosen threshold, the condition is
further refined with a lower learning rate and without
additional perturbations. In the first
stage, the condition is optimized with a relatively large
learning rate while stochastic perturbations are added to
help escape local minima. In the second stage, if the KL
loss remains above a chosen threshold, the condition is
further refined with a lower learning rate and without
additional perturbations. In the second stage, if the KL
loss remains above a chosen threshold, the condition is
further refined with a lower learning rate and without
additional perturbations. This procedure is used to improve convergence toward a condition whose generated
ensemble matches the target distribution. In the second stage, if the KL
loss remains above a chosen threshold, the condition is
further refined with a lower learning rate and without
additional perturbations. This procedure is used to improve convergence toward a condition whose generated
ensemble matches the target distribution. 5 and 3600-4096 samples
per optimization step and KL loss calculation. The purpose of the optimization is not necessarily to
recover the exact target values of ε1 and ε2. The purpose of the optimization is not necessarily to
recover the exact target values of ε1 and ε2. Since, in
the broader case, different interaction parameters might
produce similar ensemble statistics, success is instead
defined by the agreement between the generated and
target distributions.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
--- Page 11 ---
11
The model is trained to predict the Gaussian noise added during the forward diffusion process, using the standard DDPM noise-prediction mean-squared error objective <ref:2607.06421#pg6>. The diffusion timestep is encoded using a 64-dimensional sinusoidal embedding, while the timestep and condition embeddings are mapped through 128-dimensional conditioning layers <ref:2607. p. 8 Each block contains layer normalization,
FiLM scale-and-shift modulation, two linear layers, SiLU
activation, and dropout with probability 0. The diffusion timestep is encoded using a 64-dimensional sinusoidal
embedding, while the timestep and condition embeddings
are mapped through 128-dimensional conditioning layers. Each block contains layer normalization,
FiLM scale-and-shift modulation, two linear layers, SiLU
activation, and dropout with probability 0. The diffusion timestep is encoded using a 64-dimensional sinusoidal
embedding, while the timestep and condition embeddings
are mapped through 128-dimensional conditioning layers. The diffusion timestep is encoded using a 64-dimensional sinusoidal
embedding, while the timestep and condition embeddings
are mapped through 128-dimensional conditioning layers. At each diffusion step, the noisy internal-coordinate
vector, the diffusion timestep, and the condition vector
are provided to the network. The diffusion timestep is encoded using a 64-dimensional sinusoidal
embedding, while the timestep and condition embeddings
are mapped through 128-dimensional conditioning layers. At each diffusion step, the noisy internal-coordinate
vector, the diffusion timestep, and the condition vector
are provided to the network. At each diffusion step, the noisy internal-coordinate
vector, the diffusion timestep, and the condition vector
are provided to the network. The network is trained to
predict the Gaussian noise added during the forward diffusion process, using the standard DDPM noise-prediction
mean-squared-error objective.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
--- Page 13 ---
13
The authors acknowledge support from the Israel Science Foundation (ISF) under grant number 1181/24 <ref:2607.06421#pg6>. [3] Rives, A. p. 8 1126/science. aat2663
[3] Rives, A. aat2663
[3] Rives, A. Biological structure and function emerge
from scaling unsupervised learning to 250 million protein sequences. Biological structure and function emerge
from scaling unsupervised learning to 250 million protein sequences. Proceedings of the National Academy of
Sciences, 118, e2016239118, 2021. https://doi. 2016239118
[4] Salman, S. 2016239118
[4] Salman, S. , Shteingolts, S. , Shteingolts, S. , Levie, R. , Levie, R. , and Mendels,
D. , Levie, R. , and Mendels,
D. , and Mendels,
D. Evaluating the use of a machine learning simulator for
structure–property prediction: A case study on disordered 2016239118
[4] Salman, S. , Shteingolts, S. https://doi. 2016239118
[4] Salman, S. , and Mendels, D. Enabling structure-only initialization and out-of-distribution
generalization in GNN-based molecular dynamics simulators. org/abs/2605. 09495
[6] Sanchez-Gonzalez, A. 09495
[6] Sanchez-Gonzalez, A. , Godwin, J. , Godwin, J. , Pfaff, T. , Pfaff, T. ,
Leskovec, J. ,
Leskovec, J. , and Battaglia, P. , and Battaglia, P. Learning to simulate
complex physics with graph networks. html
[7] Ho, J. , and Abbeel, P. INTRODUCTION
Recent progress in machine learning has expanded the
methodological basis of molecular engineering, particularly through models that learn directly from large-scale
sequence and structural data[1–6]. Within this landscape,
Denoising Diffusion Probabilistic Models (DDPMs)[7]
have emerged as a useful generative framework for protein
ensembles. cc/paper/2020/
file/4c5bcfec8584af0d967f1ab10179ca4b-Paper. pdf
[8] Jumper, J. pdf
[8] Jumper, J. , Evans, R. , Evans, R. , Pritzel, A. , Pritzel, A. , Green, T. , Green, T. , Figurnov,
M. , Figurnov,
M. , Ronneberger, O. , Ronneberger, O. , Tunyasuvunakool, K. , Tunyasuvunakool, K. , Bates, R. , Bates, R. ,
Žídek, A. ,
Žídek, A. , Potapenko, A. , Potapenko, A. , Bridgland, A. , Bridgland, A. , Meyer, C. Highly accurate protein structure
prediction with AlphaFold. Nature, 596:583–589, 2021. https://doi. 1038/s41586-021-03819-2
[9] Lewis, S. 1038/s41586-021-03819-2
[9] Lewis, S. , Hempel, T. , Hempel, T. , Jimenez-Luna, J. , Jimenez-Luna, J. , Gastegger, M. , Gastegger, M. , Foong, A. , Foong, A. , Satorras, V. ,
Veeling, B. , Zaporozhets, I. This shifts the inverse-design problem from
targeting individual configurations such as a protein’s
native state to tuning the parameters that govern the full
conformational ensemble. Such an approach is particularly relevant because the
behavior of many physical systems, including proteins,
arXiv:2607. Scalable emulation
of protein equilibrium ensembles with generative deep
learning. Science, 389(6761):eadv9817, 2025. 1126/science. adv9817
[10] Watson, J. adv9817
[10] Watson, J. , Juergens, D. , Juergens, D. , Bennett, N. , Trippe, B. , Eisenach, H. De novo design of
protein structure and function with RFdiffusion. Nature, 620:1089–1100, 2023. press/v202/yim23a. html
[14] Liu, Y. html
[14] Liu, Y. , Lindsay, R. ExEnDiff: An experimentguided diffusion model for protein conformational ensemble generation. PRX Life, 3:023013, 2025. 1103/PRXLife. 023013
[15] Kara, C. , Hoppe, T. , Angelis, E. , Angelis, E. , Schreiner, J. Minimum-excesswork guidance: Score-based sampling with experimental
data or sparse restraints. Journal of Chemical Theory
and Computation, 2026. https://doi. 6c00080
[16] Novak, B. 6c00080
[16] Novak, B. , Lotthammer, J. , Lotthammer, J. , Emenecker, R. , Emenecker, R. , and
Holehouse, A. Accurate predictions of disordered protein ensembles with STARLING. Nature, 652:240–250,
2026. https://doi. 1038/s41586-026-10141-2
[17] Stenstrom, O. , Modig, K. , and Akke, M. Ligandinduced protein transition state stabilization switches the
binding pathway from conformational selection to induced
fit. Proceedings of the National Academy of Sciences,
121(14):e2317747121, 2024. 1073/
pnas. 2317747121
[18] Spoendlin, F. 2317747121
[18] Spoendlin, F. , Fernandez-Quintero, M. , Fernandez-Quintero, M. , Raghavan, S. , Raghavan, S. , Turner, H. , Turner, H. , Gharpure, A. , Gharpure, A. , Loeffler, J. , Loeffler, J. , Bujotzek, A. , Bujotzek, A. , Georges, G. Predicting the conformational flexibility of antibody and T
cell receptor complementarity-determining regions. Nature
Machine Intelligence, 7(10):1755–1767, 2025. https://
doi. 1038/s42256-025-01131-6
[19] Nussinov, R. , Regev, C. , and Jang, H. Leveraging
conformational ensembles in allosteric drug discovery. Trends in Pharmacological Sciences, 47(3):276–289, 2026.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
--- Page 15 ---
15
The internal-coordinate representation of such a system is 5-dimensional and can be written as: x = (r12, r23, r34, θ123, θ234) <ref:2607.06421#pg6>. Ground-truth reference ensembles have been generated using molecular dynamics simulations in LAMMPS<ref:2607. p. 4 The
internal-coordinate representation of such a system is
5-dimensional and can be written as:
x = (r12, r23, r34, θ123, θ234),
where r denotes distances and θ denotes bond angles. Ground-truth reference ensembles have been generated
using molecular dynamics simulations in LAMMPS[41]. These fivedimensional internal-coordinate samples were used as the
training data for the conditional diffusion model. The corresponding (ε1, ε2) values were extracted directly from the
LAMMPS pair coefficients and used as the conditioning
variables. 9
where the three r values are adjacent bond distances
and the two θ values are signed bond angles. These fivedimensional internal-coordinate samples were used as the
training data for the conditional diffusion model.Where the paper says it
Where the paper says it
Where the paper says it
--- Page 18 ---
18
The first parameter, ε1, was assigned to bonded-neighbor pairs, (1, 2), (2, 3), (3, 4), while the second parameter, ε2, was assigned to nextnearest-neighbor pairs <ref:2607.06421#pg6>. The remaining long-range pair (1, 4) was kept fixed at ε3 = 0. p. 7 The first parameter, ε1, was assigned to bonded-neighbor
pairs,
(1, 2), (2, 3), (3, 4),
while the second parameter, ε2, was assigned to nextnearest-neighbor pairs,
(1, 3), (2, 4). The remaining long-range pair (1, 4) was kept fixed at
ε3 = 0. The remaining long-range pair (1, 4) was kept fixed at
ε3 = 0. Each LAMMPS input file therefore defines one
trajectory and one condition vector,
ε = (ε1, ε2).Where the paper says it
Where the paper says it
--- Page 19 ---
19
The model learns a conditional ensemble distribution pθ(x ε1, ε2), where changes in the condition correspond to changes in the interaction parameters that define the four-bead system <ref:2607.06421#pg6>. The diffusion timestep is encoded using a 64-dimensional sinusoidal embedding, while the timestep and condition embeddings are mapped through 128-dimensional conditioning layers <ref:2607.06421#pg6>. At each diffusion step, the noisy internal-coordinate vector, the diffusion timestep, and the condition vector are provided to the network <ref:2607.06421#pg6>.
--- Page 23 ---
23
The optimization is performed in two stages. In the first stage, a high learning rate with stochastic perturbations are added to escape local minima <ref:2607. p. 8 Optimization is performed in two stages. In the first
stage, the condition is optimized with a relatively large
learning rate while stochastic perturbations are added to
help escape local minima.Where the paper says it
--- Page 3 ---
3
The objective is not merely structural accuracy or the optimization of specific properties, but the controlled optimization of the ensemble distribution itself <ref:2607.06421#pg2>. GB-FESO employs a conditional diffusion model as a differentiable generator of conformational ensembles <ref:2607. p. 1 For example, the relative free-energy differences between a system’s
metastable states, the overall shape of these states, or
the barriers separating them. GB-FESO employs a conditional diffusion model as a differentiable generator of
conformational ensembles. , its physical structure, chemical composition or amino acid sequence), to an ensemble of samples
that collectively define the corresponding FES. After training on a collection of state (conformational) ensembles
spanning a diverse set of systems within the domain of
interest, the parameters of the generative neural network
are frozen.Where the paper says it
Where the paper says it
--- Page 4 ---
4
The optimization is driven by an ensemble-level objective rather than by agreement between individual generated and target conformations <ref:2607.06421#pg4>. This requires a quantitative, and ideally differentiable, metric that measures agreement between the generated and target ensemble distributions <ref:2607. p. 2 Thus, our goal is to match
the ensemble distribution by backpropagating from a
distribution-level loss, rather than from a comparison of
individual samples. This requires a quantitative, and ideally differentiable,
metric that measures agreement between the generated
and target ensemble distributions. This requires a quantitative, and ideally differentiable,
metric that measures agreement between the generated
and target ensemble distributions. A natural and widely
used choice is the Kullback–Leibler (KL) divergence[30]:
DKL(P ∥ Q) = Z
p(x) log p(x)
q(x)
dx. A natural and widely
used choice is the Kullback–Leibler (KL) divergence[30]:
DKL(P ∥ Q) = Z
p(x) log p(x)
q(x)
dx. (6)
Without an explicit analytic form for the generated
distribution, the KL divergence can be approximated
with Gaussian kernel density estimation (KDE)[31], and
can be written as a differentiable loss:
DKL(ˆptarget ∥ pˆgen) ≈
1
N
X
N
j=1
log pˆtarget(xj )
pˆgen(xj )
,
xj ∼ pˆtarget.Where the paper says it
Where the paper says it
Where the paper says it
--- Page 5 ---
5
Given an input condition c, the final optimization objective can be written as c∗ = arg min c∈C h DKL(ˆptarget(x)∥ pˆgen(x)) + λDKL(ˆpDDPM(x c)∥ pˆtarget(x))i <ref:2607.06421#pg6>. The optimization is carried out by backpropagating a distribution-level loss through a deterministic diffusion sampling trajectory <ref:2607. p. 0 After training, the diffusion model is frozen, and the
conditioning variables defining the system are optimized so that the generated ensemble reproduces
a prescribed target free-energy surface. The optimization is carried out by backpropagating a
distribution-level loss, based on kernel density estimates of the Kullback–Leibler divergence, through
a deterministic diffusion sampling trajectory.Where the paper says it
--- Page 8 ---
8
The method successfully optimizes the interaction strengths to reproduce target free-energy surfaces in the large majority of test cases, including targets whose conditioning parameters lie outside the training region of the diffusion model <ref:2607.06421#pg4>. The results suggest that conditional diffusion models provide a practical route for ensemble-level molecular and materials design <ref:2607.06421#pg4>.
--- Page 9 ---
9
The optimization trajectory shown in Fig. p. 4 The simulations show that, for this simple test case,
GB-FESO is consistently able to identify the optimal conditioning variables corresponding to the predefined target
ensembles in both the continuous and discrete settings. The optimization trajectory shown in Fig. The optimization trajectory shown in Fig. 2 illustrates
several intermediate ensembles generated throughout the
optimization process. 2 illustrates
several intermediate ensembles generated throughout the
optimization process. Notably, the procedure also demonstrates the ability to extrapolate beyond the training
domain, with the DDPM converging to mean and variance values that are not present in the training data while
still generating the corresponding target distributions.Where the paper says it
Where the paper says it
Where the paper says it
--- Page 10 ---
10
The continuous version of the experiment, where mean and variance are represented directly as continuous conditioning variables, serves as a baseline for evaluating the optimization procedure <ref:2607.06421#pg6>. The discrete formulation is important because many practical molecular or material design problems involve conditioning variables that are not naturally continuous <ref:2607. p. 4 This split is used to test whether optimization of the condition vector could move the generated ensemble between
distinct regions of the learned conditional distribution. This discrete formulation is important because many
practical molecular or material design problems involve
conditioning variables that are not naturally continuous.Where the paper says it
--- Page 13 ---
13
The simulations show that, for this simple test case, GB-FESO is consistently able to identify the optimal conditioning variables corresponding to the predefined target ensembles in both the continuous and discrete settings <ref:2607.06421#pg6>. The optimization trajectory shown in Fig. 2 illustra…
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Gradient-Based Free Energy Surface Optimization (GB-FESO) can be used for ensemble-level inverse design by optimizing system design variables such as
interaction energies, chemical composition or amino acid sequence
so that the generated ensemble approaches a prescribed target distribution. This shifts the problem from targeting individual conformations to tuning parameters governing the full conformational ensemble. -
The system can be trained on a conditional diffusion model to serve as a
differentiable surrogate for the ensemble distribution.
This allows optimization bybackpropagating through a deterministic diffusion sampling trajectory
to update design variables while keeping model parameters frozen, enabling the generation of ensembles matching target free-energy surfaces. -
The method can be applied to engineer free-energy landscapes in physically motivated systems, such as a four-particle Lennard–Jones toy peptide, by optimizing interaction parameters like
LJ pair coefficients with epsilon1 representing interactions between nearest neighbors and epsilon2 representing interactions between next-nearest neighbors.
This allows the system to reproduce target free-energy landscapes in the majority of test cases. -
GB-FESO can handle both continuous and discrete conditioning variables; continuous variables are optimized directly, while discrete variables are handled via
binary logit relaxation, such as Gumbel–Softmax relaxation,
providing a differentiable route toward selecting an appropriate category. -
The improved AI system can perform ensemble-level molecular and materials design by steering generated ensembles toward
target thermodynamic behavior and target free-energy landscapes.
This is particularly useful when the desired outcome is expressed as a distribution rather than a single optimized structure, such as in catalysis or ligand recognition.
Abstract
Free-energy surfaces govern the populations of metastable states and the barriers that control transitions between them, making their direct optimization a central challenge in molecular and materials design. In this work, we introduce Gradient-Based Free Energy Surface Optimization (GB-FESO), an inverse design framework that uses a trained conditional diffusion model as a differentiable surrogate for the ensemble distribution. After training, the diffusion model is frozen, and the conditioning variables defining the system are optimized so that the generated ensemble reproduces a prescribed target free-energy surface. The optimization is carried out by backpropagating a distribution-level loss, based on kernel density estimates of the Kullback-Leibler divergence, through a deterministic diffusion sampling trajectory. We first validate GB-FESO on one-dimensional Gaussian ensembles, demonstrating that both continuous and relaxed discrete conditioning variables can be optimized to recover target distributions, including those outside the training domain. We then apply the method to a four-particle Lennard-Jones toy peptide exhibiting multiple metastable conformational states. In this more physically motivated setting, GB-FESO successfully optimizes the interaction parameters to reproduce target free-energy landscapes in the majority of test cases, with optimization performed either in the full internal-coordinate space or in a reduced collective-variable representation. These results establish GB-FESO as a promising first step toward an ensemble-level inverse design framework for molecular systems with prescribed thermodynamic and kinetic behavior.
Sources
- Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators
- Collective Variable-Guided Engineering of the Free-Energy Surface of a Small Peptide
- End-to-End Diffusion Latent Optimization Improves Classifier Guidance
- Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method
- Denoising Diffusion Implicit Models
- Learning Sparse Neural Networks through $L_0$ Regularization
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- Categorical Reparameterization with Gumbel-Softmax
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- EigenFold: Generative Protein Structure Prediction with Diffusion Models
- Explaining and Harnessing Adversarial Examples
Related papers
- Mixture of Polyconvex Neural Potentials for Parametric Hyperelasticity: Towards Foundation Material Models
- Development and large-scale benchmarks of a protein--ligand absolute binding free energy toolkit
- Spin disorder competing with positional symmetry breaking governs the metal-insulator behavior in oxide paramagnets
- Investigation of the Asymptotic Properties of Active Impedance in Large Finite Array Antennas
- Automatic generation of exchange-correlation response kernels
- Refining Machine Learning Potentials through Thermodynamic Theory of Phase Transitions