Decision-Focused Learning in MDPs: An Occupancy Measure Approach
The authors reformulate decision-focused learning in Markov Decision Processes (MDPs) using an occupancy measure-based linear program (LP) layer. This approach yields a closed-form gradient and scales to large state spaces via learnable aggregation, outperforming existing KKT-based methods in terms of regret and computational cost.