TRIAD: Ternary Information Routing for Multimodal Time-Series Sensing Signals
Yusen Liu, Shouxing Ma, Hua Lu, Xu Cheng, Xiufeng Liu, Huan Huo
摘要
Multimodal time series captured by heterogeneous sensors are fundamental to real-world applications, yet learning effective representations without labels remains challenging. Existing self-supervised methods adopt a binary paradigm that decomposes information into shared and private components, conflating two distinct types of shared information: redundancy, the consensus information recoverable from any single modality, and synergy, the emergent information arising only from joint observation. Most methods also rely on geometric constraints for disentanglement, which cannot guarantee semantic-level separation of information components. To address these limitations, we propose TRIAD, a framework that advances multimodal disentanglement from a binary to a ternary paradigm by separating a triad of information components: redundancy, synergy, and uniqueness. Inspired by Partial Information Decomposition theory, TRIAD employs a two-stage attention-based routing mechanism. The first stage extracts cross-modal redundancy, while the second stage disentangles synergy from modality-specific uniqueness. Predictive proxy tasks enforce the semantic definition of each component through prediction objectives. Extensive experiments on synthetic and real-world benchmarks show consistent improvements over state-of-the-art methods, with ablations, robustness tests, and interpretability analyses confirming that the learned components are functionally specialized.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Plug-and-play Feature Causality Decomposition for Multimodal Representation LearningYe Liu, Zihan Ji, Hongmin CaiNeurIPS 2025 · 被引用 4 次
- Factorized Contrastive Learning: Going Beyond Multi-view RedundancyPaul Pu Liang, Zihao Deng, Martin Q. Ma, James Y. Zou 等NeurIPS 2023 · 被引用 137 次
- Quantifying & Modeling Multimodal Interactions: An Information Decomposition FrameworkPaul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling 等NeurIPS 2023 · 被引用 120 次
- Disentanglement Analysis with Partial Information DecompositionSeiya Tokui, Issei SatoICLR 2022 · 被引用 16 次
- Tri-Subspaces Disentanglement for Multimodal Sentiment AnalysisChunlei Meng, Jiabin Luo, Zhenglin Yan, Zhenyu Yu 等CVPR 2026 · 被引用 7 次
