PRAGMA: Revolut Foundation Model

PRAGMA is a foundation model designed to unify complex, variable-length user histories into embeddings. It uses a key–value–time tokenization and dual encoder branches to capture both static profile state and dynamic event sequences. The model achieves superior performance across six downstream tasks, including fraud detection, and is highly efficient using LoRA fine-tuning for deployment.

Open the full episode

More from AI Radio