KINDER: Kernel-based Independence for Fair Representation Learning via Prototype-space Erasure
cs.LG, stat.ML
Submitted: 2026-10-30
Updated: 2026-10-30
Comments: NeurIPS 2026
Code: https://github.com/abtinmU/KINDER
License: http://creativecommons.org/licenses/by/4.0/
The gist: Concept erasure is a prominent approach to achieving fairness in machine learning through the removal of sensitive attributes from learned representations.
Terminology
Abstract
Concept erasure is a prominent approach to achieving fairness in machine learning through the removal of sensitive attributes from learned representations. Prior concept erasure methods typically define debiasing indirectly through the failure of a chosen adversary, probe, or fairness penalty, which makes the target of erasure dependent on a particular decoder family or optimization setup. We introduce KINDER, which directly removes sensitive-attribute information from intermediate representations with respect to a chosen family of prototype functionals, and is compatible with any deep model containing an intermediate feature space, independent of the architecture, task type, or training paradigm. KINDER operates in a random Fourier feature space, where it estimates a sensitive subspace from protected group prototypes and projects representations onto its orthogonal complement. Thus, it forms an explicit representation cleaning mechanism distinct from prior fairness control studies. We conduct extensive experiments across diverse settings and show the effectiveness of KINDER on (i) supervised and self-supervised settings, (ii) classification, regression, and image segmentation tasks, and (iii) diverse data modalities, including visual, textual, and tabular data. Code and trained models are available at: https://github.com/abtinmU/KINDER
Sources
- Obliviator Reveals the Cost of Nonlinear Guardedness in Concept Erasure
- FairSSL: Fair Multimodal Self-Supervised Learning
- Censoring Representations with an Adversary
- Slowing Learning by Erasing Simple Features
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis