Inference for High-Dimensional Regression with a Possible Threshold
summary
The gist
The paper develops a uniform inference theory for high-dimensional slope parameters in threshold regression models…
In short
The paper develops a unified inference theory for high-dimensional slope parameters in threshold regression models, applicable to both cross-sectional and time series data under near-epoch dependence. It establishes a debiased Lasso estimator that achieves uniform convergence over a large parameter space, proving its validity without needing to assume the existence of a threshold effect.
Key concepts
- Debiased Lasso Estimator (DTLasso)
- This is an improved version of the standard Lasso method used to estimate slope parameters in complex models. It works by 'debiasing' the initial Lasso estimate, which helps ensure that the resulting estimator converges correctly to the true parameter value, even when many variables are involved.
- Uniform Inference Theory
- This is a mathematical framework that allows researchers to make reliable statistical inferences (like hypothesis tests) about many parameters simultaneously. The theory here ensures these tests behave consistently and predictably across a wide range of possible parameter values.
- Near-Epoch Dependence
- This assumption is used when analyzing time series data, meaning the current observation is strongly related only to the most recent past observations, rather than the entire history. This assumption helps in developing inference methods specifically for sequential data structures.
- Threshold Regression Models
- These are statistical models where the relationship between predictors and an outcome changes abruptly once a certain threshold value is crossed. The paper applies its methods to these models, showing they can be handled even when the number of predictors exceeds the sample size.
Terminology used across episodes
This episode discusses
The paper
Inference for High-Dimensional Regression with a Possible Threshold · Read on arXiv
Huazhong University of Science and Technology · Arizona State University
This paper develops uniform inference for slope coefficients in high-dimensional threshold regressions without pretesting for a threshold effect. Confidence intervals based on a debiased threshold Lasso estimator are uniformly asymptotically valid, allowing for heteroskedasticity and non-sub-Gaussian covariates and errors. We also propose a threshold-effect test and extend inference to stationary time series. Applying the method to racial tipping in U.S. neighborhoods, we find that the relationships between white population change and residential turnover, housing age, commuting schedules, and utility payments differ across minority-share regimes. Threshold effects are detected in fewer metropolitan areas in 2000--2010 than in 1990--2000.
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Inference for High-Dimensional Regression with a Possible Threshold".
Warren: Here's the gist of the paper. The paper develops a uniform inference theory for high-dimensional slope parameters in threshold regression models, applicable to both cross-sectional and time series data under near-epoch dependence assumptions.
Ruth: The core contribution is establishing a debiased Lasso estimator that achieves uniform convergence over a large class of parameters without needing to pre-specify the existence of a threshold effect, even when the number of covariates grows much faster than the sample size (p>n).
Warren: This contrasts with existing literature primarily focused on high-dimensional linear regression frameworks.
Ruth: The theory is extended to accommodate heteroskedastic non-subgaussian error terms and non-subgaussian covariates in cross-sectional settings.
Title and authors: Ruth: We're still talking about "Inference for High-Dimensional Regression with a Possible Threshold." The authors are trying to solve the problem of estimating slope parameters in these threshold models when you have more variables than you have data points.
Warren: It’s about establishing a uniform inference theory, meaning they’re proving that their estimation and testing methods work consistently across many different parameter settings, not just one specific scenario.
Iris: The paper focuses on the main contribution being the debiased Lasso estimator itself, which is designed to handle this high-dimensional setting without needing to know if a threshold exists.
Ruth: That’s right, they show that this estimator can achieve uniform convergence over a large class of parameters, even when you have p covariates and only n observations where p is much larger than n.
Warren: They also tackle the complexity of the error terms by accommodating heteroskedastic non-subgaussian errors and non-subgaussian covariates in cross-sectional data.
Iris: And they extend this work to time series data, specifically under the near-epoch dependence assumption, which is a pretty advanced requirement for this kind of analysis.
Ruth: This paper really sets a new benchmark because existing literature has mostly focused on debiased methods within high-dimensional linear regression frameworks.
Warren: So, the implication is that you can now apply these powerful debiasing techniques to models where the underlying relationship between variables isn't just straight lines.
Iris: It opens up possibilities for analyzing complex systems where multiple regimes or states might be switching based on a few key variables.
The paper's summary: Ruth: To summarize what they found, the main takeaway is that their debiased Lasso estimator works uniformly across a broad set of parameters without needing to specify the existence of a threshold effect beforehand.
Warren: They show that the asymptotic distributions of tests involving an increasing number of slope parameters are identical whether there is no threshold effect or with a fixed threshold effect present.
Iris: That’s a neat result because it means you can perform uniform inference without needing to commit to one model structure or another, which is really powerful for model selection.
Ruth: Beyond that, they derive oracle inequalities for prediction errors and one estimation errors under those more general conditions we mentioned earlier <ref:2404.08105#pg1,oracle inequalities for prediction errors and>.
Warren: They also prove that the debiased Lasso estimator is asymptotically normal when you look at a linear combination of parameters, which gives us confidence intervals that are asymptotically honest and contract at the optimal rate.
Iris: The time series extension means we can apply this uniform inference theory to high-dimensional time series threshold regression under near-epoch dependence conditions.
Ruth: So, they’ve built a framework that is robust enough to handle high dimensions, complex errors, and non-linear relationships in both cross-sectional and time series data.
Warren: It means we can get reliable estimates and tests even when the number of covariates explodes relative to our sample size.
Iris: The paper really solidifies the idea that we don't need to pre-specify a threshold structure to use these powerful debiasing tools for high-dimensional problems.
The paper's improvements: Ruth: One of the major improvements they propose is moving away from just focusing on linear regression frameworks and applying debiased methods in those simpler settings.
Warren: They show that their method can work when you have non-subgaussian covariates and heteroskedastic error terms, which is a big step in terms of generality for cross-sectional data.
Iris: And they extend this to the time series setting under the near-epoch dependence assumption, which is a necessary extension for those kinds of dependent data structures.
Ruth: The core improvement is establishing that the debiased Lasso estimator achieves uniform convergence over a large class of parameters without needing to pre-specify a threshold effect.
Warren: That’s key because it contrasts with previous work that was heavily focused on linear regression settings, so this broadens the applicability significantly.
Iris: They also improve oracle inequalities for prediction errors and one estimation errors by allowing for those more general conditions on the error terms and covariates <ref:2404.08105#pg1,oracle inequalities for prediction errors and>.
Ruth: So, they’re not just solving one problem; they're making the tools more versatile to handle a wider variety of real-world data complexities.
Conclusion: Ruth: To wrap up, this paper introduces inference for high-dimensional regression with a possible threshold by showing a debiased Lasso estimator that performs uniformly across many parameter settings without needing to pre-specify the threshold.
Warren: The key results are the identical asymptotic distributions of tests in both no threshold and fixed threshold cases, and the uniform normality of the debiased Lasso estimator over a large zero ball <ref:2404.08105#pg2>.
Iris: The time series extension is also important, allowing us to apply this theory to high-dimensional time series models under near-epoch dependence conditions.
Ruth: This paper suggests that we can perform reliable inference in high dimensions even when the data structure is complex and non-linear, without needing a simple pre-defined model type.
Warren: The authors have shown how to handle more general error structures, which means the results apply to a wider range of real-world applications than previously thought.
Iris: Overall, this work provides a solid framework for analyzing complex systems where you have many parameters and complex data dependencies in both cross-sectional and time series settings.
More episodes
- Daily Summary for 2026-11-19
- 2608.21274-Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
- 2408.02757-A nonparametric test for diurnal variation in spot correlation processes
- 2306.16393-High-Dimensional Canonical Correlation Analysis
- 2605.17299-Geometric Brownian motion with intermittent entries and exits
- 2607.04753-Fooling Yourself: how narratives shape beliefs
- 2408.14671-Inference on Treatment Effects with Repeatedly Mismeasured High-Dimensional Controls
- 2201.06898-Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period
- 2501.15307-Influence Functions: A Unified Differentiation-Based Framework
- The day in conversation for 2026-11-19