Directly Optimizing Mean Demographic Parity for Nonlinear Regression
cs.LG, stat.ML
Submitted: 2026-07-06
Updated: 2026-10-08
License: http://creativecommons.org/licenses/by/4.0/
The gist: When sensitive attributes are continuous and high-dimensional - demographic score vectors, posteriors over attributes, age or income profiles - enforcing full statistical independence is often too
Terminology
Abstract
When sensitive attributes are continuous and high-dimensional - demographic score vectors, posteriors over attributes, age or income profiles - enforcing full statistical independence is often too restrictive, and existing relaxations rely on indirect dependence penalties or adversarial schemes that do not directly target the fairness-accuracy trade-off. We instead consider mean demographic parity through DPVar, the variance of the conditional-mean prediction given the sensitive attribute, and show that optimizing it yields a functional bilevel problem. We propose two algorithms for this problem: FBO, which uses a closed-form adjoint we derive for the squared-loss case to obtain an exact hypergradient, and ITD, which differentiates through unrolled inner steps and extends beyond squared loss. On synthetic data and a new semi-synthetic benchmark built from 60 tabular regression datasets, both methods achieve the lowest or near-lowest aggregate fairness-accuracy regret, and consistently match or outperform strong HSIC, adversarial, linear-dependence, and generalized-DP baselines.
Sources
- Projection to Fairness in Statistical Learning
- Fairness-informed Pareto Optimization : An Efficient Bilevel Framework
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks