Lune

ICML2026顶会

Geometry of Reason: Spectral Signatures of Valid Mathematical Reasoning

Valentin NOËL

2026年份
4被引次数

摘要

Verifying whether a language model is genuinely reasoning or pattern-matching remains an open problem: learned verifiers are expensive, and output-based heuristics are brittle. We show that valid mathematical reasoning induces a measurable, training-free spectral signature in transformer attention. By treating each attention matrix as a weighted token graph, we extract four diagnostics: Fiedler value, High-Frequency Energy Ratio (HFER), spectral entropy, and smoothness, that require no learned parameters. Experiments across seven models from four architectural families yield effect sizes up to Cohen's d=3.30d = 3.30 (p<10−116p < 10^{-116}), enabling 8585-9696% single-threshold classification accuracy. Two findings sharpen the interpretation. First, Platonic validity: the spectral signal tracks logical coherence rather than compiler acceptance, proofs rejected for timeouts or missing imports are correctly classified as valid, a distinction confirmed by a manual audit (κ=0.82\kappa = 0.82, n=51n = 51). Second, architectural determinism: Sliding Window Attention shifts the discriminative feature from HFER to smoothness (d=2.09d = 2.09, p<10−48p < 10^{-48}), showing that attention design governs which spectral channel encodes reasoning quality. Causal ablation confirms the signature traces induction-head circuits. The method generalises to informal chain-of-thought (d=0.78d = 0.78, p<10−3p < 10^{-3}), and in proof search, HFER reranking improves Best-of-16 Pass@1 by +4.4+4.4-6.66.6%, matching 9898% of the AUC of fully supervised probes with zero labels. Spectral graph analysis is a principled, architecture-aware primitive for reasoning verification.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

它引用的顶会 Paper21

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖