Bayesian Multiple Imputation for Functional Data
summary
The gist
Bayesian multiple imputation for functional data develops BAMIFun to address the limitations of single-imputation methods by explicitly incorporating estimation uncertainty into downstream analyses…
In short
BAMIFun is a Bayesian multiple imputation method for functional data that uses penalized splines to enforce trajectory smoothness and quantify estimation uncertainty. It improves upon single-imputation methods by providing valid downstream inferences through Rubin's rules, enabling more reliable analysis of incomplete time-series data.
Key concepts
- Bayesian Multiple Imputation
- This technique fills in missing data multiple times using a probabilistic framework. Instead of one guess, it generates several plausible datasets based on prior beliefs and then pools the results to account for the uncertainty inherent in those guesses.
- Penalized Splines
- These are mathematical functions used to model the smooth shape of functional data. By adding a penalty term related to the second derivative, the method ensures that imputed trajectories are not only plausible but also adhere to a desired level of smoothness, preventing unrealistic jumps in the data.
- Functional Tensor Singular Value Decomposition (FTSVD)
- This is an advanced mathematical model used to handle complex multiway functional data. It decomposes the high-dimensional data into simpler components, allowing the imputation process to work effectively even when observations are indexed across multiple dimensions, such as different subjects and time points.
Terminology used across episodes
This episode discusses
The paper
Bayesian Multiple Imputation for Functional Data · Read on arXiv
University of Minnesota
Missing data are pervasive in modern functional datasets, where trajectories are often sparsely or irregularly observed. Although Functional Principal Component Analysis (FPCA) is widely used to reconstruct incomplete curves, existing approaches typically employ single imputation, leading to overly optimistic inferences in downstream analyses. To address these challenges, we develop a novel Bayesian multiple imputation framework for functional data (BAMIFun). For single-level functional data, we impose a Bayesian low-rank model that incorporates penalized spline representations to enforce smoothness of the functional domain and derive an efficient Gibbs sampler algorithm for posterior computation. In addition, we demonstrate and validate how to properly account for estimation uncertainties in downstream analysis. Furthermore, we extend the framework to multiway functional data using Functional Tensor Singular Value Decomposition (FTSVD) model, enabling Bayesian multiple imputation in settings not supported by existing methods. Simulation studies show that BAMIFun achieves substantially improved coverage and more reliable downstream inference compared to existing methods, while maintaining similar imputation accuracy. Case studies using a physical activity dataset and an infant gut microbiome dataset further demonstrate the practical advantages of our proposed methods under severe missingness. The code is available at https://github.com/ZirenJiang/BAMIFun.
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Bayesian Multiple Imputation for Functional Data".
Jane: Here's the gist of the paper. Bayesian multiple imputation for functional data develops BAMIFun to address the limitations of single-imputation methods by explicitly incorporating estimation uncertainty into downstream analyses The BAMIFun framework provides a principled approach to reconstructing incomplete trajectories while quantifying the uncertainty arising from the imputation Framework Development The BAMIFun algorithm is a Bayesian multiple imputation framework for functional data that embeds penalized splines within a Bayesian framework to enforce trajectory smoothness It performs multiple imputation for single-level functional data via a low-rank representation and achieves valid downstream inference by pooling estimates using Rubin’s rules Furthermore, it extends the framework to multiway functional data using Functional Tensor Singular Value Decomposition (FTSVD) model, enabling Bayesian multiple imputation in settings not supported by existing methods Single-Level Data Modeling For single-level functional data, the model assumes a low-rank structure X = VUT + E where V is an N×R matrix, U is a K×R matrix, and E is an N×K matrix of i.i.d.
Tom: Gaussian error terms The functional data X is assumed to be smooth along the functional domain I by the low-rank factor matrix U, represented as UT = BΘ where Θ is an L × K matrix of spline basis functions The additional smoothness constraint on U can be induced by adding a penalty on the integral of the squared second derivative R(u''r(t)) squared dt Inference and Uncertainty Quantification For downstream analysis, BAMIFun constructs the 95% credible interval for functional observations as
Xˆ L i(tk), Xˆ U i(tk): where Xˆ U i(tk) is the 0.975 quantile of the posterior samples The point estimate β̂(t) for the functional coefficient can be obtained by pooling estimates from separate SoFR models using Rubin’s rule to construct the total variance VˆT(t) = VˆW(t) + (1+ 1/S)VˆB(t) Multiway Data Extension For multiway functional data, BAMIFun adopts the FTSVD model which approximates the multiway functional data through the decomposition X = UΛ(W ⊙ V) T + E The Gibbs sampler for multiway BAMIFun under (7) is presented in the Supplementary Material Section S5.2 Simulation and Validation Simulation studies show that BAMIFun achieves substantially improved coverage and more reliable downstream inference compared to existing methods, while maintaining similar imputation accuracy Case studies using a physical activity dataset and an infant gut microbiome dataset further demonstrate the practical advantages of our proposed methods under severe missingness The results show that BAMIFun consistently outperforms BAMITA in terms of imputation accuracy across all settings and maintains coverage close to the nominal level throughout (93.3%–94.0% at N = 100 and 96.8%–98.8% at N = 300) Computational Cost BAMIFun is more expensive than frequentist FPCA imputation, ranging from roughly 40 seconds at N = 100 to about 7 minutes at N = 1,000 in the single-level simulation In the multiway simulation it ranges from roughly 2 minutes at N = 100 to about 18 minutes at N = 1,000 reflecting the additional cost of its penalized-spline smoothness updates within the Gibbs sampler Case Study Results In the NHANES data case study, BAMIFun provides empirical coverage close to the nominal level for the estimated 95% credible intervals across all levels of missingness The pooled β̄(t) closely tracks the oracle coefficient fit to the unmasked profiles even when 90–97.5% of each subject’s curve is unobserved Discussion BAMIFun gains substantially improved coverage and valid downstream inference, as confirmed in our simulations and applications For multiway functional data, the performance instead depends on the structure, as BAMIFun is more accurate when a low-rank structure is present It attains close-to-nominal coverage and remains applicable under extreme missingness, whereas existing MFPCA software cannot run References Chiou, J.-M., Chen, Y.-T.
Jane: and Yang, Y.-F.
Tom: (2014), ‘Multivariate functional principal component analysis: A normalization approach’, Statistica Sinica pp.
Title and authors: Tom: So we're looking at this paper called Bayesian Multiple Imputation for Functional Data by Ziren Jiang, Lei Xuan, Eric F. Lock, and Erjia Cui. Jane, what’s the main thing this title tells us right off the bat?
Jane: It’s basically saying they are using a Bayesian approach to fill in missing data when that data is functional—that means it’s a curve or a time series—and they are doing multiple imputation, which is filling in those gaps.
Lu: And I think the key word here is "Bayesian." That means instead of just guessing the best fit, they’re incorporating uncertainty into their guesses right from the start.
Meng: Uncertainty sounds nice in theory, but for production AI, we need to know what breaks when we use those guesses. Is this method stable at scale?
Lalam: I think it addresses a big problem because existing methods often rely on single imputation, which just gives you one possible answer and makes everything else look too good.
Tom: Exactly. So, they are tackling the limitations of those older single imputation methods by building something new to handle missing trajectories in functional data.
The paper's summary: Jane: Okay, so what exactly is BAMIFun? It sounds like a framework designed specifically for this problem. Can you explain the core idea behind the BAMIFun framework in simple terms?
Lu: Well, it sets up a Bayesian low-rank model for single-level functional data and puts penalized splines inside that Bayesian structure to force smoothness on the trajectory.
Tom: For someone listening, that just means they’re not letting the imputed curve be wiggly or jagged; they are using mathematical constraints to keep the shape of the missing part realistic.
Meng: So, what about how many different curves can this handle? Because if we have complex data, we need something more than just one level.
Lalam: They actually extend it beyond single-level data to multiway functional data by using something called Functional Tensor Singular Value Decomposition, or FTSVD model.
Jane: FTSVD is the tool they use for multiway data, which means if you have observations indexed over multiple things—like subject and visit time points—this method can handle it where other tools fail.
Tom: It’s a big jump from just one curve to handling entire data structures that are much more complex than simple single trajectories.
The paper's improvements: Lu: The main improvement they point out is how they handle uncertainty in the final analysis, which is crucial. They construct a ninety-five percent credible interval for those functional observations themselves.
Jane: That’s smart because it means you don't just get one line; you get a range of possibilities for that curve, which gives much more reliable inference later on.
Meng: So, if I use these results to train a prediction model, the uncertainty quantification has to be solid. How do they make sure those confidence intervals are actually accurate?
Tom: They achieve this by pooling estimates from different imputation runs using Rubin’s rules, which gives you a total variance that accounts for both the missing data within one imputation and the differences between the imputations themselves.
Lalam: That total variance formula they use is V sub hat t equals V sub hat w t plus one over one plus S times V sub hat b t. It’s designed to properly combine those two sources of uncertainty into a single, sensible measure.
Jane: So, the improvement isn't just filling in the blanks; it’s giving you mathematically sound confidence intervals for whatever you want to do next with that data.
Conclusion: Tom: So we’ve seen how BAMIFun uses Bayesian methods and penalized splines to handle missing functional data and how they use Rubin's rules to give us proper uncertainty quantification. Jane, what’s the final word on what this paper means for people who don't read statistics?
Jane: It means that when you are working with missing curves, you can move past the overly optimistic guesses of single imputation and get inferences that are much more reliable because they properly account for all the ways uncertainty enters your analysis.
Lu: I think what’s really interesting is how it scales. They show it can handle multiway data using FTSVD, which opens up possibilities for complex datasets in fields like genomics that have multiple dimensions of observation.
Meng: From a deployment standpoint, the computational cost is something we have to watch. The simulation showed that the cost goes up pretty fast with sample size N, reaching about eighteen minutes at one thousand samples for multiway data. That’s a factor we need to consider when thinking about running this on live traffic.
Lalam: I just want to say that they show empirical validation too. In their case studies on physical activity and gut microbiome data, BAMIFun outperformed another method called BAMITA in terms of accuracy across all settings and kept the coverage close to what was expected, hitting between ninety-three point three percent and ninety-four point zero percent at one hundred samples.
Tom: So it’s a solid piece of work that shows a principled way to reconstruct incomplete trajectories while quantifying the uncertainty behind those reconstructions. That’s what this paper is all about with Bayesian multiple imputation for functional data.
More episodes
- Daily Summary for 2026-11-19
- 2310.07973-Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning
- 2408.09155-Learning Robust Treatment Rules for Censored Data
- Daily Summary for 2026-11-19
- 2603.23397-Kinetic Langevin Splitting Schemes for Constrained Sampling
- 2606.09906-An information-geometric framework for mapping maximum potential biodiversity
- 2603.27718-Induced replication and the assessment of models
- 1307.0898-Entropy of a Zipfian Distributed Lexicon
- 2406.19974-Generalizing self-normalized importance sampling with couplings
- 2412.10213-Collaborative Optimal Design of Controlled Experiments with Subject Covariates