Sparse-TD-JEPA: Improving Zero-Shot Reinforcement Learning With Sparse Latent Task Representations

Sparse-TD-JEPA introduces an L1 sparsity penalty during training for a task encoder's latent representations. This forces the reward-predictive structure into a smaller subspace, concentrating reward signals. This results in significantly improved zero-shot reinforcement learning performance across various benchmarks by creating sharper, more goal-focused reward landscapes.

Open the full episode

More from AI Radio