Lune

ICML2026顶会

Chiral Symmetry Breaking in Transformers: A Group-Equivariant Framework for Addressing the Reversal Curse via Adjoint Manifold Mappings

Hanji Du

出版方
2026年份

摘要

The "reversal curse" exposes a critical asymmetry in autoregressive models, where models trained on facts in one direction often fail to access the corresponding inverse relation. This work studies the phenomenon from a representation-level perspective, characterizing it as a form of chiral asymmetry between subject- and object-oriented latent states. We introduce the Chiral Transformer, a lightweight framework that encourages an involutive adjoint mapping operator T\mathcal{T} through contrastive regularization. At inference time, Adjoint-Induced Retrieval (AIR) uses this learned map as a structured readout over model-derived entity representations, rather than as an unconstrained autoregressive generation protocol. Empirical validation on inverse-relation benchmarks shows that this symmetry-aware retrieval setting substantially improves inverse factual access, with AIR reaching 65.07% accuracy on Fact-Inv-300. These findings support a representation-access view of the reversal curse: inverse relations may be difficult not only because of missing data, but also because standard autoregressive readout fails to expose useful latent structure.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

它引用的顶会 Paper9

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖