AURA: Visually Interpretable Affective Understanding via Robust Archetypes
Guanyu Hu, Dimitrios Kollias, Xinyu Yang
摘要
Interpretable methods such as vision--language models (VLMs) have advanced affect analysis by aligning images with textual descriptions. However, relying on text as an intermediate proxy faces critical limitations: linguistic templates are inherently discrete, making them fundamentally incompatible with continuous valence--arousal regression, while also acting as a bottleneck for fine-grained visual nuances. Cognitive psychology suggests that human affective perception is not mediated by linguistic translation, but is grounded in perceptual resemblance to internalized visual archetypes. Motivated by this, we propose AURA, an archetype-based framework that replaces brittle linguistic proxies with a self-organizing archetype manifold. By adaptively allocating representational density according to affective complexity, AURA enables accurate continuous regression and reshapes affective taxonomies by decomposing labels into interpretable, geometrically coherent visual primitives. This paradigm offers a transparent, visually grounded decision trail and achieves state-of-the-art results across discrete and continuous tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen 等ICLR 2021 · 被引用 1,731 次
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 被引用 1,438 次
- Efficient Test-Time Model Adaptation without ForgettingShuaicheng Niu, Jiaxiang Wu, Yifan Zhang, Yaofo Chen 等ICML 2022 · 被引用 579 次
- Test-Time Classifier Adjustment Module for Model-Agnostic Domain GeneralizationYusuke Iwasawa, Yutaka MatsuoNeurIPS 2021 · 被引用 456 次
相关 Paper
- A Unified and Interpretable Emotion Representation and Expression GenerationReni Paskaleva, Mykyta Holubakha, Andela Ilic, Saman Motamed 等CVPR 2024 · 被引用 5 次
- See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion RecognitionJingjing Hu, Dan Guo, Haofan Cheng, Zeng ying 等ICML 2026 · 被引用 1 次
- A Brain-Inspired Way of Reducing the Network Complexity via Concept-Regularized Coding for Emotion RecognitionHan Lu, Xiahai Zhuang, Qiang LuoAAAI 2024
- E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous DrivingYihong Tang, Haicheng Liao, Tong Nie, Junlin He 等CVPR 2026 · 被引用 2 次
- Affective Image Filter: Reflecting Emotions from Text to ImagesShuchen Weng, Peixuan Zhang, Zheng Chang, Xinlong Wang 等ICCV 2023 · 被引用 25 次
