Dynamic Strategy Selection
cs.LG, q-fin.PM, stat.ME, stat.ML
Submitted: 2023-07-07
Updated: 2026-11-04
Comments: Substantially revised version. Proofs and bounds have been corrected, the focus and application have changed, and a new coauthor has been added
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: We consider the problem of dynamically selecting among competing strategies using observable predictors.
Terminology
Abstract
We consider the problem of dynamically selecting among competing strategies using observable predictors. To mitigate estimation noise and excessive switching, we regularise the estimated policy with a switching cost, which may exceed actual transaction costs when these are too small to provide sufficient regularisation. Since switching costs make current choices affect future decisions, we formulate the problem using dynamic programming. The optimal policy is estimated using a reinforcement learning algorithm based on iterated regressions, making the procedure simple to implement. We apply the method to monthly rotation among momentum, value, profitability, and defensive U.S. equity factors over a sample of about 60 years. Using a parsimonious set of state variables, the estimated policy outperforms both the myopic dynamic policy and the best fixed factor in hindsight in out-of-sample evaluation. Under weak conditions, we show theoretically that the decision rule estimated from empirical data is asymptotically consistent for the unknown optimal decision rule. Simulation results illustrate the finite-sample relevance of these asymptotic results.
Sources
- Temporal-Difference estimation of dynamic discrete choice models
- Dynamically Optimal Treatment Allocation
- STEEL: Singularity-aware Reinforcement Learning
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning