Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs".
Jane: Here's the gist of the paper. The regression discontinuity (RD) design is widely used for program evaluation with observational data because it can provide credible causal inference without assuming that the treatment is unconfounded <ref:2208.13323#pg3>.
Tom: This paper develops a robust optimization approach to finding optimal treatment cutoffs that improve upon the existing ones <ref:2208.13323#pg2>.
Jane: Problem Setup and Goal The research addresses the gap in literature regarding policy learning under RD designs by developing a methodology for learning new and better cutoffs from observed data <ref:2208.13323#pg3>.
Tom: The goal is to find a new policy π that has a high average value (expected utility) for the overall population V(π) = E
Y (π(X, G)): <ref:2208.13323#pg3>.
Title and authors: Tom: So Jane and I are looking at this paper today called "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs." It's about how to learn better treatment cutoffs when you're using regression discontinuity designs, which is super important for policy evaluation because it lets us get causal answers even when we don't assume the treatment is unconfounded.
Jane: Right, Tom. So the core problem they're tackling here is that standard methods usually only tell you how good the treatment effect is right at the existing cutoff, but this paper looks at policy learning—basically figuring out which cutoff to choose to get a better overall outcome for everyone.
Lu: Exactly. Because the treatment assignment is deterministic, finding a new better cutoff means we have to extrapolate beyond what we've seen in the data, and that's where it gets tricky. They develop an approach using robust optimization to find these optimal cutoffs that actually improve upon the existing ones they already have.
Meng: I’m curious about how they handle the fact that you can’t just look at one cutoff; how do you manage all those potential cutoffs at once? If we're trying to deploy this in a real system, we need something scalable and reliable, not just a theoretical trick.
Jane: Well, the paper sets up by decomposing what you want to find—the expected utility—into two parts: things they can identify directly and things that are unidentifiable. Then they propose an efficient doubly robust estimator for those identifiable parts, which is pretty clever because it only needs mild convergence conditions on their models.
Tom: That doubly robust estimator sounds like a solid foundation, but the real meat of this paper is how they handle the unidentifiable component, which they call epsilon one. They partially identify that part using something called parallel trends assumptions in a relaxed way to get an estimate for it.
Lu: They use this structure to leverage the fact that there are multiple cutoffs common under the regression discontinuity design, assuming that how expectations vary across different groups changes smoothly along the running variable. This assumption is what lets them make progress on the unidentifiable stuff.
Meng: Smoothness assumptions can be tough to verify in practice, especially when you're dealing with real-world data where things are messy. What does this smooth variation actually mean for our deployment cost?
Title and authors: Jane: It means they are using the existence of multiple cutoffs as a sort of anchor to make sense of the unidentifiable component, rather than trying to solve it perfectly. They then use robust optimization to find an optimal policy by maximizing the worst case expected utility across a specific class of policies called the overlap class.
Tom: Maximizing the worst case is key here because it gives us a safety guarantee, which is what they call pi inf. This means no matter what weirdness happens in the data, this policy won't be worse than your current status quo policy.
Lu: And they get a theoretical safety guarantee too. Theorem one shows that the expected utility loss of their learned safe policy relative to the baseline is bounded by something involving a square root of n and terms related to the worst-case variance V*g. This gives us some concrete bounds on how much we can expect to lose.
Meng: Bounded by a term involving sqrt n sounds good asymptotically, but what does that mean for the actual time it takes for our model to converge in a real deployment scenario? Is that convergence fast enough?
Jane: They also have Theorem two, which bounds the empirical optimality gap under multi-cutoff regression discontinuity designs by something proportional to lambda wgg prime and the average distance to the nearest cutoff. This links how far apart those cutoffs are directly to how much better their learned policy can be.
Tom: So, in practice, this means we can use a smoothness parameter lambda w12 and choose a larger value for it if we want more conservative inference, which keeps our learned policy closer to the baseline. That’s a trade-off we have to manage.
Lu: They also discuss how they estimate that smoothness parameter lambda by fitting a local polynomial regression on either side of the cutoff and taking the largest local curvature, or through a data-driven method based on two stage doubly robust estimation to estimate something called d(w, x, g, g') at fixed points.
Meng: Fitting a local polynomial regression sounds computationally intensive. If we're running this in production on massive datasets with many groups, how much overhead are we talking about for estimating that smoothness parameter?
Jane: It depends on the setup. They also have an algorithm, Algorithm one to estimate heterogeneous crossgroup differences by constructing a pseudo-outcome regression based on nuisance training data and regressing it on covariates in a test sample to get an estimate for d(w, x, g, g') above the existing cutoff <ref:2208.13323#pg2>.
Title and authors: Tom: That sounds like they're using the data they already have to inform the learning process for new cutoffs. It’s a clever use of existing information.
Lu: And finally, they discuss future directions: generalizing some assumptions to include other observed covariates, incorporating fairness or risk factors into the policy class, and extending this framework to discrete running variables or even exploring safe policy learning in other designs like tie-breaker designs.
Meng: Extending it to discrete variables might be a practical step for us. What about the computational cost of training these robust optimization models if we add more covariates? Will it just scale poorly?
Jane: The paper flags that generalizing Assumption two is an area for future work, but they also suggest exploring safe policy learning in other study designs, like tie-breaker designs. That suggests the core idea—finding safe policies under uncertainty—is broadly applicable beyond just standard regression discontinuity setups.
Tom: So to wrap up, this paper on "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs" shows a robust way to find better treatment cutoffs by breaking the problem down, using doubly robust estimators for the identifiable parts, and employing robust optimization for the unidentifiable parts.
Jane: The main result is that you can learn new cutoffs with a safety guarantee that they won't be worse than your current policy, and they provide asymptotic regret bounds relative to both your baseline and an oracle optimal policy.
Lu: This work provides a framework for making better decisions in environments where you only have observational data, giving us tools to move beyond just estimating the effect at one specific point.
Meng: For deployment purposes, the main caution is that estimating those smoothness parameters requires careful setup, like fitting local polynomials or using complex two stage estimation to get those estimates right.
Lalam: From my perspective in the literature database, this paper connects several ideas—doubly robust estimation for unidentifiable parts and robust optimization for policy selection—into a cohesive learning pipeline. I am quite sure of its theoretical soundness regarding the safety guarantees.
Tom: It’s solid work, but remember that the practical success really hinges on how well those underlying smoothness assumptions hold true in the data you're actually working with.
Jane: Right, and as we wrap up this discussion on "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs," this paper gives us a rigorous way to think about improving policy decisions when we have observational data, even when extrapolating beyond the known cutoff points.
The paper's summary: Jane: So, to wrap up what we just heard, this paper is about taking those regression discontinuity designs and making them safe when you have multiple cutoffs instead of just one.
Tom: Right, so the main takeaway is that they developed a whole pipeline for learning better treatment cutoffs that has a safety guarantee.
Lu: They do this by breaking down the expected utility into parts they can directly measure and parts they can't identify, then using a doubly robust estimator for the measurable pieces and robust optimization to handle the unknown ones.
Meng: So, what does that actually mean for deployment? Does it mean we can just plug in a new cutoff number without worrying about introducing a huge risk?
Jane: It means they find an optimal policy that maximizes the worst case utility across all those potential cutoffs they consider, which gives you this safety net where the learned policy won't be worse than what you already have.
Tom: And they show with some simulations that as you get more data, this learned safe policy actually gets better at reducing its regret compared to your original status quo policy.
Lu: They also got theoretical bounds showing how much the empirical gap between their best learned policy and the actual optimal one is controlled by how spread out those multiple cutoffs are.
Meng: So, if I'm running this on real traffic, what’s the practical hurdle? Is this a super slow process for finding these new cutoffs?
Jane: The paper points out that choosing how smooth you assume the expected outcome function is using a smoothness parameter lambda w12 is important; it controls how conservative your inference is. A larger lambda means they're safer, but the policy might be further away from your original baseline cutoff.
Tom: That's a trade-off we have to manage: safety versus closeness to the old method. And they even suggest ways to estimate that smoothness parameter using local polynomial regression or some two stage estimation based on the data.
Lu: They also developed an algorithm, Algorithm one that lets you estimate those crossgroup differences by using the training data itself to build a pseudo-outcome regression and then testing it on new data to get an estimate for how much the outcome changes with that smoothness parameter.
Meng: That sounds like it needs a lot of setup work before you even start looking for a cutoff. What about scaling this up? If I have hundreds of departments, will this training process take forever?
Jane: They are exploring future work on incorporating fairness or risk factors directly into the policy class, and they also suggest applying these safe policy learning ideas to other designs, like tie-breaker designs.
Tom: So we're looking at a method that can handle multiple cutoffs and give us a bound on how much worse our new policy could be than the old one.
Lu: Exactly. It moves the problem from just finding a single best point to learning an entire class of safe policies under extrapolation.
Jane: This work sets up a framework for making better decisions in environments where you only have observational data, even when you have multiple potential cutoffs to consider.
Tom: And it provides those regret bounds, which is concrete evidence that the method actually performs well as the sample size grows.
Lu: We can see how this connects to other work on robust causal inference and policy learning in high-dimensional settings, like the federated learning papers we've been looking at.
The paper's improvements: Tom: So, we've talked about what the paper found regarding safety guarantees and those regret bounds relative to your baseline policy. Now we look at how they suggest actually improving this system itself.
Jane: What are the suggested improvements for making this whole learning process more robust or accurate? Is it just tweaking some parameters, or a complete overhaul of the math?
Lu: The authors are proposing a few things: first, they can choose the smoothness parameter lambda wgg prime by fitting a local polynomial regression on either side of the cutoff and taking the largest local curvature.
Meng: Fitting a local polynomial regression sounds like it could be computationally expensive. How much overhead are we talking about for that estimation step when you're running this in production?
Tom: It depends on the setup, but they also have a data-driven method to estimate that same smoothness parameter by using two stage doubly robust estimation to figure out something called d of w x g g prime at fixed points.
Jane: So it's not just one way to estimate that smoothness; they are suggesting multiple ways to get the right setting for their safety net.
Lu: They also have an algorithm, Algorithm one, which helps you estimate how much different groups vary by constructing a pseudo-outcome regression from the training data and testing it on new samples to get an estimate for d of w x g g prime above the existing cutoff.
Meng: That sounds like a lot of pre-processing work just to find the right settings before you even start learning. What about generalizing these assumptions? Can we make this work when there are more covariates involved?
Jane: They specifically suggest generalizing Assumption two to include other observed covariates, which means they want to see if this framework can handle more messy real-world data structures.
Tom: And they also look at incorporating fairness or risk factors directly into the policy class itself, which would change what kind of decisions the AI is allowed to make.
Lu: They are also looking at extending this whole framework to discrete running variables, which means moving away from the smooth functions they're assuming and dealing with things that jump instead of flow.
Meng: Moving to discrete variables sounds like it could be a headache for deployment because the continuous optimization methods might not apply cleanly. What about those other study designs?
Jane: They also suggest exploring safe policy learning in other designs, like tie-breaker designs, which means this idea is broader than just standard regression discontinuity setups.
Tom: So, the improvements focus on making the parameter estimation more flexible and broadening the applicability of these safety guarantees across different data structures.
Lu: The main point is that they are giving us a toolbox to handle more complex modeling challenges while keeping an eye on those safety bounds.
Conclusion: Jane: So we’re wrapping up this discussion on "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs." Essentially, this paper shows how to learn better treatment cutoffs when you have multiple cutoffs instead of just one.
Tom: Right, it gives us a robust pipeline that uses decomposition and robust optimization to find an optimal policy that has a safety guarantee against the existing status quo.
Lu: The implication is that we can move beyond just guessing one cutoff point and start learning a whole range of safe policies under uncertainty.
Meng: It means for production, we have a method to select a treatment rule that won't accidentally perform worse than what we currently have deployed, which is important because running models on real traffic has high stakes.
Lalam: I’m very confident in this direction; the theoretical bounds they establish show that the regret of their learned safe policy falls with terms related to n and the worst case variance.
Jane: That's what we were talking about; those numbers give us a concrete idea of how much better or worse our new policy could be than what we already have.
Tom: It’s a solid paper because it doesn't just propose an idea; it lays out the mechanics and shows the empirical results from applications like the ACCES loan program in Colombia.
Lu: The practical challenge, though, is that estimating those smoothness parameters requires careful setup with local polynomials or two stage estimation, which adds complexity to deployment.
Meng: And I'm worried about that complexity when we are trying to ship something quickly; if it takes too much tuning just to set up the learning process, it’s not a good engineering solution.
Jane: It definitely needs careful setup, but the potential benefit is that this framework is more flexible and can handle more complex real-world data structures than standard methods.
Tom: Exactly; by looking at other designs like tie-breaker designs, the authors show this idea isn't limited to just one specific type of regression discontinuity.
Lu: This work connects the ideas of doubly robust estimation with robust optimization in a way that provides strong safety guarantees, which is something we need when dealing with observational data.
Lalam: I am sure this paper represents a significant step forward because it takes the theoretical concept of policy learning and makes it practically actionable for real-world systems.
Jane: So, to summarize, "Safe Policy Learning under Regression Discontinuity Designs with Multiple Cutoffs" gives us a rigorous way to improve policy decisions when we have multiple potential cutoffs and provides safety guarantees against the status quo.
Tom: It’s a lot of work in terms of estimation setup, but the results show it works and provides measurable performance bounds.
Lu: We need to keep an eye on those future directions, especially generalizing assumptions to include fairness or risk factors in the policy class.
Yi Zhang, Eli Ben-Michael, Kosuke Imai
Harvard University · Carnegie Mellon University
stat.ME, econ.EM
Submitted: 2022-08-29
Updated: 2026-11-16
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 88/100
The gist: The regression discontinuity (RD) design is widely used for program evaluation with observational data because it can provide credible causal inference without assuming that the treatment is…
Key concepts
- Regression Discontinuity (RD) Design
- A design where treatment assignment is deterministic based on whether an observed covariate crosses a specific cutoff point. It's used for causal inference when randomization isn't possible, allowing researchers to estimate treatment effects by comparing outcomes just above and just below the cutoff.
- Expected Utility $V(\pi)$
- The overall value or benefit of a chosen policy $\pi$. The goal is to find a new policy that maximizes this expected utility for the entire population, which is what the learning process aims to achieve by optimizing treatment cutoffs.
- Doubly Robust Estimation ($\\Xi_{bDR}$)
- A statistical technique used to estimate unidentifiable parts of the expected utility. It combines two different estimation methods (cross-fitting nonparametric estimates) to achieve semiparametric efficiency, requiring only mild convergence conditions on the underlying nuisance models.
- Robust Optimization
- A mathematical approach used to find a policy that performs well even under uncertainty. Here, it's used to maximize the worst-case expected utility over a restricted set of policies, ensuring the learned policy is safe relative to the existing status quo.
Terminology
Summary
The regression discontinuity (RD) design is widely used for program evaluation with observational data because it can provide credible causal inference without assuming that the treatment is unconfounded <ref:2208. p. 113323#pg3>. This paper develops a robust optimization approach to finding optimal treatment cutoffs that improve upon the existing ones <ref:2208. p. 013323#pg2>.
Problem Setup and Goal
The research addresses the gap in literature regarding policy learning under RD designs by developing a methodology for learning new and better cutoffs from observed data <ref:2208.13323#pg3>. The goal is to find a new policy π that has a high average value (expected utility) for the overall population V(π) = E [Y (π(X, G))] <ref:2208. p. 413323#pg3>. The policy class considered is the class of group-specific linear threshold policies ΠMulti = 1(x ≥ cg), cg ∈ X <ref:2208. p. 513323#pg3>. Since treatment assignment is deterministic, learning a new policy requires extrapolation <ref:2208. p. 113323#pg3>.
Methodological Framework
The proposed framework has three steps: decomposing expected utility into identifiable and unidentifiable components, partially identifying the unidentifiable component using a relaxed version of the “parallel-trends” assumption, and proposing a robust optimization approach that maximizes the worst case expected utility <ref:2208.13323#pg4>. The decomposition of expected utility V (π, m) is given by Equation (3) which separates it into identifiable and non-identifiable terms Iiden and Iuniden <ref:2208. p. 613323#pg4>.
Doubly Robust Estimation
The second term Ξ1 in the unidentifiable component is partially identified using a doubly robust estimator ΞbDR <ref:2208.13323#pg5>. This estimator involves cross-fitting nonparametric estimates for the nuisance components ˜m(x, g) and eg(x) <ref:2208. p. 113323#pg5>. The empirical quantity ΞbDR achieves semiparametric efficiency while only requiring mild sub-parametric convergence rate conditions of the two nuisance models <ref:2208.13323#pg5>.
Robust Optimization and Safety Guarantee
The final step involves using robust optimization to find an optimal policy by maximizing the worst case value of the expected utility V (π, d) over the restricted policy class ΠOverlap <ref:2208.13323#pg5>. The resulting maximin value optimal policy πinf has a safety guarantee that it will not yield a worse overall utility than the existing status quo policy <ref:2208. p. 013323#pg5>.
Empirical Application and Results
The methodology is applied to the ACCES loan program in Colombia, learning new cutoffs for each department <ref:2208.13323#pg7>. Simulation studies show that the regret of the learned safe policy relative to the baseline policy improves with sample size n, and decreases as n gets large <ref:2208. p. 113323#pg8>. The results indicate that a larger value of the smoothness parameter λw12 leads to more conservative inference, i.e., the learned policy is closer to the baseline <ref:2208. p. 313323#pg8>.
Theoretical Guarantees
Theorem 1 establishes a statistical safety guarantee, showing that the expected utility loss of the learned safe policy ˆπ relative to the baseline policy ˜π is bounded by a term involving √n and terms related to worst-case variance V∗g <ref:2208.13323#pg52>. Theorem 2 shows that the empirical optimality gap under multi-cutoff regression discontinuity designs is bounded by a term proportional to λwgg' and the average distance to the nearest cutoff <ref:2208.13323#pg54>.
Future Directions
Future work could involve generalizing Assumption 2 to include other observed covariates, incorporating fairness or risk factors into the policy class, extending the framework to discrete running variables, or establishing safety guarantees for specific subpopulations <ref:2208.13323#pg55>. The paper also suggests exploring the use of safe policy learning in other study designs like tie-breaker designs <ref:2208. p. 013323#pg55>.
References
Angrist, J. D. and M. Rokkanen (2015). p. 2 Wanna get away? regression discontinuity estimation of exam school effects away from the cutoff <ref:2208. p. 013323#pg28>.
Armstrong, T. p. 1 B. and M. Koles´ar (2018). p. 1 Optimal inference in a class of regression models <ref:2208. p. 113323#pg28>.
Athey, S. and S. Wager (2021). p. 2 p. 2 Policy learning with observational data <ref:2208. p. 013323#pg35>.
Ben-Michael, E. p. 0, D. J. Greiner, K. Imai, and Z. p. 0 Jiang (2021). p. 1 Safe policy learning through extrapolation: Application to pre-trial risk assessment <ref:2208. p. 213323#pg2>.
Bertanha, M. p. 2 p. 2 (2020). Regression discontinuity design with many thresholds <ref:2208. p. 013323#pg34>.
Bertanha, M. and G. W. Imbens (2020). p. 2 External validity in fuzzy regression discontinuity designs <ref:2208. p. 013323#pg35>.
Bertsimas, D. p. 3, K. Imai, and M. p. 0 L. Li (2023). Distributionally robust causal inference with observational data <ref:2208. p. 113323#pg52>.
Calonico, S. p. 1 p. 1, M. D. Cattaneo, and M. p. 2 H. Farrell (2018). p. 1 On the effect of bias estimation on coverage accuracy in nonparametric inference <ref:2208. p. 113323#pg28>.
Calonico, S., M. D. Cattaneo, and R. p. 2 Titiunik (2014). p. 1 Robust nonparametric confidence intervals for regression-discontinuity designs <ref:2208. p. 013323#pg34>.
Card, D., C. Dobkin, and N. Maestas (2009). p. 1 Does medicare save lives? The quarterly journal of economics 124 (2), 597–636 <ref:2208. p. 013323#pg28>.
Cattaneo, M. p. 2 D., L. Keele, R. Titiunik, and G. p. 1 Vazquez-Bare (2020). p. 0 Extrapolating treatment effects in multi-cutoff regression discontinuity designs <ref:2208. p. 013323#pg35>.
Chay, K. Y., P. J. McEwan, and M. Urquiola (2005). p. 1 The central role of noise in evaluating interventions that use test scores to rank schools <ref:2208. p. 113323#pg28>.
Cheng, M.-Y., J. Fan, and J. S. Marron (1997). p. 1 On automatic boundary corrections <ref:2208. p. 013323#pg28>.
Dahabreh, I. p. 6 J., S. E. Robertson, E. J. Tchetgen, E. p. 2 A. Stuart, and M. p. 6 A Hern´an (2019). p. 1 Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals <ref:2208. p. 413323#pg29>.
Dong, Y. and A Lewbel (2015). p. 2 Identifying the effect of changing the policy threshold in regression discontinuity models <ref:2208. p. 013323#pg35>.
Dowd, C. (2021). Donuts and distant cates: Derivative bounds for rd extrapolation <ref:2208. p. 013323#pg35>.
Eckles, D., N. Ignatiadis, S. Wager, and H. p. 1 Wu (2020). Noise-induced randomization in regression discontinuity designs <ref:2208. p. 013323#pg35>.
Eggers, A. C. and J. Hainmueller (2009). p. 1 Mps for sale? returns to office in postwar british politics <ref:2208. p. 013323#pg28>.
Heckman, J. p. 1 J. and E. Vytlacil (2005). p. 1 Structural equations, treatment effects, and econometric policy evaluation 1 <ref:2208. p. 013323#pg35>.
Imbens, G. and K. Kalyanaraman (2012). p. 2 Optimal bandwidth choice for the regression discontinuity estimator <ref:2208. p. 013323#pg35>.
Imbens, G. and S. Wager (2019). p. 1 Optimized regression discontinuity designs <ref:2208. p. 013323#pg35>.
Imbens, G. W. and T. Lemieux (2008). p. 1 Regression discontinuity designs: A guide to practice <ref:2208. p. 013323#pg35>.
Jia, Z., E. Ben-Michael, and K. p. 0 Imai (2023). p. 3 Bayesian safe policy learning with chance constraint optimization: Application to military security assessment during the vietnam war <ref:2208. p. 113323#pg52>.
Jin, Y., Z. Ren, Z. Yang, and Z. Wang (2022). p. 2 Policy learning” without”overlap: Pessimism and generalized empirical bernstein’s inequality <ref:2208. p. 213323#pg35>.
Kallus, N. and A Zhou (2018). p. 3 Confounding-robust policy improvement <ref:2208. p. 013323#pg52>.
Kennedy, E. H. (2020). Towards optimal doubly robust estimation of heterogeneous causal effects <ref:2208. p. 313323#pg52>.
Khan, S., M. Saveski, and J. Ugander (2023). p. 3 Off-policy evaluation beyond overlap: partial identification through smoothness <ref:2208. p. 213323#pg42>.
Kim, W., K. Kwon, S. Kwon, and S. Lee (2018). p. 1 The identification power of smoothness assumptions in models with counterfactual outcomes <ref:2208. p. 213323#pg42>.
Kitagawa, T. p. 2 and A. Tetenov (2018). p. 2 Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice <ref:2208. p. 213323#pg42>.
Klaˇsnja, M. p. 1 and R. Titiunik (2017). p. 1 The incumbency curse: Weak parties, term limits, and unfulfilled accountability <ref:2208.13323#pg28>.
Koles´ar, M. p. 1 and C. Rothe (2018). p. 1 Inference in regression discontinuity designs with a discrete running variable <ref:2208. p. 113323#pg35>.
Lee, D. S. and T. Lemieux (2010). p. 1 Regression discontinuity designs in economics <ref:2208. p. 013323#pg35>.
Lee, D. S., E. Moretti, and M. J. Butler (2004, August). p. 1 Do voters affect or elect policies? p. 2: Evidence from the U.S. house <ref:2208. p. 013323#pg35>.
Li, H. H. and A B Owen (2022). p. 2 A general characterization of optimal tie-breaker designs <ref:2208. p. 213323#pg52>.
Manski, C. F. (1997). Monotone treatment response <ref:2208. p. 413323#pg52>.
Mealli, F. and C Rampichini (2012). p. 2 Evaluating the effects of university grants by using regression discontinuity designs <ref:2208. p. 013323#pg28>.
Melguizo, T. p. 1, F. Sanchez, and T. Velasco (2016). p. 0 Credit for low-income students and access to and academic performance in higher education in colombia: A regression discontinuity approach <ref:2208. p. 113323#pg35>.
Newey, W. K. and J. R. Robins (2018). p. 1 Cross-fitting and fast remainder rates for semiparametric estimation <ref:2208.13323#pg47>.
Neyman, J. (1990 [1923]). p. 3 On the application of probability theory to agricultural experiments <ref:2208.13323#pg29>.
Nie, X., E. Brunskill, and S. Wager (2021). Learning when-to-treat policies <ref:2208. p. 213323#pg47>.
Noack, C. and C Rothe (2019). p. 1 Bias-aware inference in fuzzy regression discontinuity designs <ref:2208. p. 113323#pg35>.
Pu, H. and B Zhang (2021). p. 3 Estimating optimal treatment rules with an instrumental variable: A partial identification learning approach <ref:2208. p. 813323#pg35>.
Qian, M. and S. A Murphy (2011). p. 2 Performance guarantees for individualized treatment rules <ref:2208. p. 013323#pg35>.
Rambachan, A. p. 5 and J Roth (2023). p. 5 A more credible approach to parallel trends <ref:2208. p. 513323#pg52>.
Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies <ref:2208.13323#pg29>.
Sacks, J. and D Ylvisaker (1978). Linear estimation for approximately linear models <ref:2208. p. 513323#pg35>.
Stuart, E. A., S. R. Cole, C. P. Bradshaw, and P. J. Leaf (2011). p. 2 The use of propensity scores to assess the generalizability of results from randomized trials <ref:2208. p. 213323#pg29>.
Sun, L. (2021). Empirical welfare maximization with constraints <ref:2208. p. 013323#pg55>.
Swaminathan, A. p. 2 and T Joachims (2015). p. 2 Counterfactual risk minimization: Learning from logged bandit feedback <ref:2208. p. 813323#pg35>.
Yata, K. (2021). Optimal decision rules under partial identification <ref:2208. p. 513323#pg35>.
Zhan, R., Z. Ren, S. Athey, and Z. p. 2 Zhou (2021). p. 3 Policy learning with adaptively collected data <ref:2208. p. 013323#pg47>.
Zhao, Y., D Zeng, A J Rush, and M R Kosorok (2012). p. 2 Estimating individualized treatment rules using outcome weighted learning <ref:2208. p. 013323#pg35>.
Zhou, Z., S. Athey, and S. p. 2 Wager (2018). p. 1 Offline multi-action policy learning: Generalization and optimization <ref:2208. p. 513323#pg47>.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Robust Policy Learning Under Regression Discontinuity Designs can be performed by decomposing expected utility into point-identifiable and unidentifiable components, then proposing a doubly-robust estimator for the identifiable parts and leveraging multiple cutoffs to account for unidentifiable components.
-
The improved system can learn new treatment cutoffs that have a safety guarantee that they will not yield a worse overall outcome than the existing status quo policy, which is achieved by minimizing the worst case utility loss relative to the status quo policy.
-
The system can estimate policy value using an empirical analog derived from Equation 12, and for the non-identifiable component, it can compute a doubly robust estimator ΞbDR (Equation 14) that achieves semiparametric efficiency while only requiring mild sub-parametric convergence rate conditions of the two nuisance models.
-
The system can estimate the worst case value of Ξ2 using an empirical quantity Ξb2 (Equation 15) and an empirical model class Mcd, allowing it to find an optimal policy by maximizing the worst case in-sample value across policies pi in ΠOverlap.
-
The system can choose the smoothness parameter lambda wgg' by fitting a local polynomial regression on either side of the cutoff and taking the largest local curvature as Sw, or through a data-driven method based on two-stage doubly robust estimation to estimate d(w, x, g, g') at fixed points.
-
The system can learn policies that are safe relative to the baseline policy under single-cutoff RD designs by imposing an approximately linear model assumption on the conditional expectation function of potential outcomes (Assumption B.1) and using robust optimization over a restricted model class M to find an optimal policy that maximizes the worst case value at the lower bound Bl.
-
The system can estimate heterogeneous crossgroup differences using Algorithm 1, which constructs a pseudo-outcome regression based on nuisance training data and regresses it on covariates in a test sample to yield an estimate for d(w, x, g, g') above the existing cutoff.
-
The system can provide asymptotic regret bounds for the learned safe policy relative to the baseline policy (Theorem 1) and relative to the oracle optimal policy (Theorem 2), quantifying performance with terms related to Q and V star g.
Sources
- Safe Policy Learning through Extrapolation: Application to Pre-trial Risk Assessment
- nprobust: Nonparametric Kernel-Based Estimation and Robust Bias-Corrected Inference
- Locally Robust Semiparametric Estimation
- Noise-Induced Randomization in Regression Discontinuity Designs
- Optimal Dynamic Treatment Regimes and Partial Welfare Ordering
- Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality
- Towards optimal doubly robust estimation of heterogeneous causal effects
- Off-policy evaluation beyond overlap: partial identification through smoothness
- A general characterization of optimal tie-breaker designs
- Cross-Fitting and Fast Remainder Rates for Semiparametric Estimation
- Bias-Aware Inference in Fuzzy Regression Discontinuity Designs
- Empirical Welfare Maximization with Constraints
- Optimal Decision Rules Under Partial Identification
- Policy Learning with Adaptively Collected Data
- Offline Multi-Action Policy Learning: Generalization and Optimization
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes