Transformer-based In-Context Score Operator Learning for Diffusion Models

arXiv:2610.13690 · cs.LG · Submitted 2026-10-09 · Read on arXiv

cs.LG

Submitted: 2026-10-09

Updated: 2026-10-09

Code: https://github.com/woodssss/In-context-learning-for-Diffusion-Models

Terminology

• Diffusion Model — 1× in this paper · explained in 9 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• Improving In-Context Learning in Diffusion Models with Visual Context-Modulated Prompts
• In-Context Learning of Linear Systems: Generalization Theory and Applications to Operator Learning
• In-Context Operator Learning on the Space of Probability Measures
• Learn to Evolve: Self-supervised Neural JKO Operator for Wasserstein Gradient Flow
• What Can Transformers Learn In-Context? A Case Study of Simple Function Classes
• Few-Shot Diffusion Models
• Classifier-Free Diffusion Guidance
• A Score-based Generative Solver for PDE-constrained Inverse Problems with Complex Priors
• DiffusionPDE: Generative PDE-Solving Under Partial Observation
• Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
• DiffWave: A Versatile Diffusion Model for Audio Synthesis
• Score Neural Operator: A Generative Model for Learning and Generalizing Across Multiple Probability Distributions
• Symbolic Music Generation with Diffusion Models
• Context Diffusion: In-Context Aware Image Generation
• Diffusion Models for Adversarial Purification
• Imitating Human Behaviour with Diffusion Models
• State of the Art on Diffusion Models for Visual Computing
• Goal-Conditioned Imitation Learning using Score-based Diffusion Policies
• Generating High-Resolution Regional Precipitation Using Conditional Diffusion Model
• Score-Based Generative Modeling through Stochastic Differential Equations

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks