MERIT: Scaling KG Foundation Models with Relation Transformers
MERIT introduces a framework using a transformer over relation names instead of message-passing on relation graphs. It uses motif tensors as a soft prior to guide attention, matching state-of-the-art zero-shot performance while keeping training and inference costs comparable to ULTRA models.