Rethinking Positional Encoding and Interaction Granularity for CTR Prediction

arXiv:2610.37140 · cs.IR · Submitted 2026-10-27 · Read on arXiv

cs.IR

Submitted: 2026-10-27

Updated: 2026-10-27

Comments: 13 pages, 11 figures

License: http://creativecommons.org/licenses/by/4.0/

The gist: Click-through rate (CTR) prediction relies on historical behaviors and contextual features to estimate clicks on a target item.

Abstract

Click-through rate (CTR) prediction relies on historical behaviors and contextual features to estimate clicks on a target item. Existing Transformer-based CTR models often adopt index-based or temporal positional encodings and token-level causal interaction. However, we observe that most existing positional encodings do not outperform NoPE, while relaxing causal constraints within target-relative temporal groups also yields gains. These observations motivate a fundamental question: what positional encoding and interaction granularity does CTR prediction actually require? To address this question, we propose TRIP, which combines target-aware rank--time positional encoding with temporal-group interaction modeling. Specifically, Factorized Rank Encoding represents each behavior's ordinal position within the historical sequence through a low-rank factorization, while Target-Relative Time Encoding characterizes its temporal distance to the target on a coarse-to-fine scale. This joint design grounds each behavior's positional representation in its sequence context and temporal relation to the current target. Furthermore, Temporal Group-Causal Interaction enriches intra-group representations through bidirectional interaction and masked reconstruction while preserving inter-group causal order. Finally, behavior representations are condensed into compact group summaries for efficient group-level modeling in subsequent layers. Experiments on four public benchmarks show that TRIP improves AUC by up to 4.45% relative to the strongest baseline.

Related papers