MATH · IN · MODELS

Contrastive reflection-intent directions steer reflective behavior

measured in 1 paper

Chang, Lee & Wu construct steering vectors between no-reflection, intrinsic-reflection, and triggered-reflection conditions in Qwen2.5-3B and Gemma3-4B-IT [chang-etal-2025-unveiling-latent-directions-of-reflection] Adding or subtracting the direction enhances or suppresses reflective behavior on GSM8k-adv and Cruxeval-o-adv [chang-etal-2025-unveiling-latent-directions-of-reflection] Suppression is empirically easier than induction [chang-etal-2025-unveiling-latent-directions-of-reflection] The three reflection conditions are clearly separable in activation space, confirming a real behavioral axis rather than a construction artifact [chang-etal-2025-unveiling-latent-directions-of-reflection]

Context

reflection, reasoning-behavior

Papers

Unveiling the Latent Directions of Reflection in Large Language Models — Chang, Fu-Chieh, Lee, Yu-Ting, Wu, Pei-Yuan2025 · arXiv:2508.16989