TRIAD: Ternary Information Routing for Multimodal Time-Series Sensing Signals
Yusen Liu, Shouxing Ma, Hua Lu, Xu Cheng, Xiufeng Liu, Huan Huo
Abstract
Multimodal time series captured by heterogeneous sensors are fundamental to real-world applications, yet learning effective representations without labels remains challenging. Existing self-supervised methods adopt a binary paradigm that decomposes information into shared and private components, conflating two distinct types of shared information: redundancy, the consensus information recoverable from any single modality, and synergy, the emergent information arising only from joint observation. Most methods also rely on geometric constraints for disentanglement, which cannot guarantee semantic-level separation of information components. To address these limitations, we propose TRIAD, a framework that advances multimodal disentanglement from a binary to a ternary paradigm by separating a triad of information components: redundancy, synergy, and uniqueness. Inspired by Partial Information Decomposition theory, TRIAD employs a two-stage attention-based routing mechanism. The first stage extracts cross-modal redundancy, while the second stage disentangles synergy from modality-specific uniqueness. Predictive proxy tasks enforce the semantic definition of each component through prediction objectives. Extensive experiments on synthetic and real-world benchmarks show consistent improvements over state-of-the-art methods, with ablations, robustness tests, and interpretability analyses confirming that the learned components are functionally specialized.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Plug-and-play Feature Causality Decomposition for Multimodal Representation LearningYe Liu, Zihan Ji, Hongmin CaiNeurIPS 2025 · 4 citations
- Factorized Contrastive Learning: Going Beyond Multi-view RedundancyPaul Pu Liang, Zihao Deng, Martin Q. Ma, James Y. Zou et al.NeurIPS 2023 · 137 citations
- Quantifying & Modeling Multimodal Interactions: An Information Decomposition FrameworkPaul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling et al.NeurIPS 2023 · 120 citations
- Disentanglement Analysis with Partial Information DecompositionSeiya Tokui, Issei SatoICLR 2022 · 16 citations
- Tri-Subspaces Disentanglement for Multimodal Sentiment AnalysisChunlei Meng, Jiabin Luo, Zhenglin Yan, Zhenyu Yu et al.CVPR 2026 · 7 citations
