AdaPrivate-TS: Private Thompson Sampling for Contextual Bandits with Privacy Amplification
Mohammadreza Riyazat, Eranga Ukwatta
cs.LG, cs.CR, stat.ML
Submitted: 2026-06-19
Comments: Accepted at the 39th Canadian Conference on Artificial Intelligence (Canadian AI 2026) as a long paper; selected for oral presentation. 12 pages, 6 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: We present AdaPrivate-TS, a differentially private contextual bandit algorithm that combines Thompson Sampling with batched zCDP composition.
Terminology
Abstract
We present AdaPrivate-TS, a differentially private contextual bandit algorithm that combines Thompson Sampling with batched zCDP composition. Our key insight is that differential privacy noise inflates the posterior covariance in a structured way: adding Gaussian noise N(0, sigma squared I) to b yields sampling covariance v squared A-1 + sigma squared A-2, which Thompson Sampling interprets as increased uncertainty rather than pure corruption. Under event-level privacy (protecting individual interactions) with stochastic contexts, we prove that the privacy cost is only O(sqrt d, T/sqrt rho), logarithmic in T, because parallel composition amortizes noise across batches. Additionally, we explore privacy amplification via Poisson subsampling, which can reduce effective noise at stringent privacy budgets. Experiments on synthetic and real-world datasets demonstrate: (1) AdaPrivate-TS achieves 93-99% of non-private performance at epsilon in [0.5, 5], outperforming UCB by 0.5-3.7% and up to 18% with tuned adaptive exploration at extreme epsilon; (2) privacy amplification provides additional 2-5% gains at low epsilon; (3) on MovieLens and Jester, AdaPrivate-TS achieves the best overall performance among event-level baselines, dominating at epsilon at least 2; (4) under DP-SVD private features, TS's advantage over UCB grows to +11%, confirming noise-as-uncertainty is not limited to reward privacy. We provide rigorous proofs for privacy guarantees under interactive zCDP composition and comprehensive evaluation including convergence curves, 12-seed CIs, and DP-SVD feature ablation.
Sources
- R'enyi Differential Privacy of the Sampled Gaussian Mechanism
- Concentrated Differential Privacy for Bandits
- Dynamic Global Sensitivity for Differentially Private Contextual Bandits
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks