Bayesian MI-LASSO for Variable Selection on Multiply-Imputed Data

summary

The gist

Multiple imputation is widely used for handling missing data in realworld applications.

In short

This work extends MI-LASSO to a Bayesian framework by proposing four models—three shrinkage prior-based and one Spike-Slab prior-based—to select variables from multiply-imputed data. The approach uses shared penalized priors on grouped coefficients to ensure consistent variable selection across all imputed datasets, showing superior performance in simulations and real data applications.

Key concepts

Multiple Imputation (MI)
MI is a technique used to handle missing data by creating several complete datasets based on statistical models. The analysis is then performed on each dataset, and the results are combined to provide more accurate inferences than using a single imputed dataset.
MI-LASSO
This method uses multiple imputation combined with the LASSO regularization technique for variable selection. It treats variables within groups as related and uses a group LASSO approach to select consistent variables across all the different imputed datasets.
Bayesian MI-LASSO
This extension incorporates a Bayesian framework by placing shared, penalized priors on grouped coefficient vectors. This structure allows the model to incorporate group-level information through these priors, leading to coherent uncertainty estimates and consistent variable selection across imputations.

Terminology used across episodes

This episode discusses

The paper

Bayesian MI-LASSO for Variable Selection on Multiply-Imputed Data · Read on arXiv

Columbia University · Rutgers University

Transcript

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Bayesian MI-LASSO for Variable Selection on Multiply-Imputed Data".

Jane: Here's the gist of the paper. Multiple imputation is widely used for handling missing data in realworld applications.

Tom: In this work, we focus on variable selection using multiply-imputed data.

Jane: MI-LASSO, one of the most commonly used approaches to this problem, regards the same variable across all separate imputed datasets as a group variable and exploits the group LASSO to yield a consistent variable selection across all the multiply-imputed datasets.

Tom: In this paper, we extend MI-LASSO to a Bayesian framework and propose four Bayesian MI-LASSO models for variable selection on multiply-imputed data.

Paper summary: Jane: So to wrap up, we've looked at the paper called Bayesian MI-LASSO for Variable Selection on Multiply-Imputed Data. It proposes extending MI-LASSO into a Bayesian framework with four different models, including shrinkage and Spike-Slab priors, all aimed at making variable selection more consistent across different imputed datasets >

Tom: The authors are arguing that this method provides a robust way to do variable selection on multiply-imputed data by using a four-step projection predictive procedure instead of ad hoc thresholding >

Lu: The key is the extension into the Bayesian framework, placing those shared priors on each grouped coefficient vector beta j, which enables consistent selection across all imputations >

Meng: It seems like for practical use, they are recommending starting with Horseshoe or ARD because they don's require tuning and deliver strong performance >

Jane: And that’s the big picture: we have a framework here for handling missing data and variable selection that offers better consistency than standard methods >

Tom: The implication is that if you're dealing with complex missing data scenarios, this paper gives you a solid blueprint for building systems where variable selection doesn't suddenly change depending on which dataset you look at >

Conclusion: Tom: So, we're wrapping up this look at "Bayesian MI-LASSO for Variable Selection on Multiply-Imputed Data." Essentially, they took standard variable selection methods and put them inside a Bayesian framework to handle data that has missing pieces in multiple places.

Jane: The authors are using these four different Bayesian models—three shrinkage priors and one Spike-Slab prior—to figure out which variables are actually important when you have that missing data problem.

Lu: They introduce this idea of placing a shared, penalized prior on each group of coefficients, which is the core mechanism that lets them find consistent variable selection across all those different imputed datasets.

Meng: From an engineering standpoint, what they're doing here is moving away from guessing thresholds and instead using a projection predictive procedure to make sure the variable selection stays stable even when you're making inferences after selecting your variables.

Tom: It sounds like they are showing that this Bayesian approach isn't just a theoretical exercise; it actually delivers better performance than MI-LASSO or other alternatives in terms of accuracy and error rates.

Jane: And the big implication for us is that if you're working with complex missing data—like in medical studies or environmental science—this method offers a much more robust way to get reliable results about which variables are driving the outcome.

Lu: The paper shows that even though they have four different model choices, they all perform quite well, and the choice between shrinkage and Spike-Slab depends on whether you want higher sensitivity or higher specificity for your variable selection.

Tom: It's interesting how they tie this together with a specific real-world study on dioxin exposure data from the University of Michigan; it shows these methods work in practice, not just on simulated data.

Jane: And that leads us to the next part where we'll look at what those specific results actually mean for understanding those environmental exposures.

More episodes

← Home