Multi-Step Knowledge Interaction Analysis via Rank-2 Subspace Disentanglement

arXiv:2511.01706 · cs.CL, cs.AI, cs.LG · Submitted 2025-11-03 · Read on arXiv

cs.CL, cs.AI, cs.LG

Submitted: 2025-11-03

Updated: 2026-09-01

Comments: Accepted at EMNLP Findings 2026

Code: https://github.com/copenlu/pk-ck-knowledge-disentanglement

License: http://creativecommons.org/licenses/by/4.0/

The gist: Natural Language Explanations (NLEs) describe how Large Language Models (LLMs) make decisions by drawing on external Context Knowledge (CK) and Parametric Knowledge (PK).

Terminology

Abstract

Natural Language Explanations (NLEs) describe how Large Language Models (LLMs) make decisions by drawing on external Context Knowledge (CK) and Parametric Knowledge (PK). Understanding the interaction between these sources is key to assessing NLE grounding, yet these dynamics remain underexplored. Prior work has largely focused on i) single-step generation and ii) modeled PK--CK interaction as a binary choice within a rank-1 subspace. This approach overlooks richer interactions and how they unfold over longer generations, such as complementary or supportive knowledge. We propose a novel rank-2 projection subspace that disentangles PK and CK contributions more accurately and use it for the first multi-step analysis of knowledge interactions across longer NLE sequences. Experiments across four QA datasets and three open-weight LLMs demonstrate that rank-1 subspaces struggle to represent diverse interactions, whereas our rank-2 formulation captures them effectively, highlighting PK alignment for supportive interactions and CK alignment for conflicting ones. Our multi-step analysis reveals that hallucinated generations exhibit strong alignment with the PK direction, though context-faithful generations maintain a more balanced alignment between PK and CK.

Sources

Related papers