Polar probing (distance + angle)

methods / Direction Extraction / Polar probing (distance + angle)

Techniqueintermediate

Jointly fits a structural (distance-based, existence) probe and a contrastive angular probe (direction-based, type/orientation) as one linear transform, so that squared distance encodes whether a relation exists and the angle between edge vectors encodes which type of relation it is.

Used in (1 observation)

Syntactic relations are encoded as directions, not just distancesmeasured

structure: Tree Metric Embedding, Concept Crystals (Parallelogram/Trapezoid Structure) · models: Llama-2-7B, Mistral-7B-v0.1, BERT-large · paper: A polar coordinate system represents syntax in large language models