Mapping the Circumplex of Affect: Geometric Analysis of Emotion Representations via Hyperspherical Contrastive Learning
Yusuke Yamauchi, Akiko Aizawa
Abstract
Psychological research has long utilized circumplex models to structure emotions, placing similar emotions adjacently and opposing ones diagonally. Although frequently used to interpret deep learning representations, these models are rarely directly incorporated into the representation learning of language models, leaving their geometric validity unexplored. This paper proposes a method to induce circular emotion representations within language model embeddings via contrastive learning on a hypersphere. We show that while this circular alignment offers superior interpretability and robustness against dimensionality reduction, it underperforms compared to conventional designs in high-dimensional settings and fine-grained classification. Our findings elucidate the tradeoffs involved in applying psychological circumplex models to deep learning architectures. Our code is available at https://github.com/ yama11235/EmpiricalCircumplexModel
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5de609b-c5f4-4d95-ab0d-93838840c526Builds on15
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Inference-Time Intervention: Eliciting Truthful Answers from a Language ModelKenneth Li, Oam Patel, Fernanda B. Viégas, Hanspeter Pfister et al.NeurIPS 2023 · 1,549 citations
- Refusal in Language Models Is Mediated by a Single DirectionAndy Arditi, Oscar Obeso, Aaquib Syed, Daniel Paleka et al.NeurIPS 2024 · 1,166 citations
- The Linear Representation Hypothesis and the Geometry of Large Language ModelsKiho Park, Yo Joong Choe, Victor VeitchICML 2024 · 461 citations
- Towards Understanding Grokking: An Effective Theory of Representation LearningZiming Liu, Ouail Kitouni, Niklas Nolte, Eric J. Michaud et al.NeurIPS 2022 · 299 citations
Related papers
- A Circular-Structured Representation for Visual Emotion Distribution LearningJingyuan Yang, Jie Li, Leida Li, Xiumei Wang et al.CVPR 2021
- Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language ModelsBenjamin Z. Reichman, Adar Avsian, Larry HeckICLR 2026 · 14 citations
- Distributed Representations of Emotion Categories in Emotion SpaceXiangyu Wang, Chengqing ZongACL 2021
- A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion RecognitionWenjie Zheng, Jianfei Yu, Rui XiaACM MM 2024 · 8 citations
- Emergence of Hierarchical Emotion Organization in Large Language ModelsMaya Okawa, Bo Zhao, Eric Bigelow, Rose Yu et al.ICML 2026 · 4 citations
