A mean-difference binding-ID direction in Q/K space redirects attention

Oh & Demberg treat binding IDs as approximately linear directions in the query and key activation spaces of selected attention heads, estimated as mean differences between binding-ID conditions [oh-demberg-2026-retrieval-conditioned-rebinding-circuit] Adding these directions to Gemma2-9B-it, Gemma3-12B-it, Llama-3.2-3B-it, and Llama-3.1-8B-it's Q/K activations causally redirects attention to the corresponding object [oh-demberg-2026-retrieval-conditioned-rebinding-circuit] The intervention shifts the final logits accordingly [oh-demberg-2026-retrieval-conditioned-rebinding-circuit] The representational signature, whether the effect concentrates in Q and K jointly or in K alone, differs across model families [oh-demberg-2026-retrieval-conditioned-rebinding-circuit]