ICML2026
Stable Spectral Copula Alignment for Robust Multimodal Learning
Hongkang Zhang, Shao-Lun Huang, Yanlong Wang, Ercan KURUOGLU
摘要
Multimodal alignment can fail under deployment shift because standard objectives entangle cross-modal dependence with marginal-sensitive geometry. Stable Spectral Copula Alignment (SSCA) provides a deployment protocol for copula-stable dependence under approximately coordinate-wise monotone marginal distortions, together with auditable, label-free diagnostics for monitoring and mitigation. SSCA combines (i) clipped soft-rank Gaussianization that suppresses marginal effects while tracking tie and approximation errors, (ii) dependence-weighted sliced Wasserstein hub coupling for globally coherent multiway alignment with cycle auditing, and (iii) diagonal-stabilized block-spectral learning with eigengap-normalized Davis-Kahan diagnostics, yielding an actionable subspace-risk inequality. A calibrated gate maps diagnostic proxies to a reliability signal with a measurable false-alarm/miss trade-off, enabling stability-mode updates, budgeted remediation, and conservative no-update fallback for out-of-scope drift. Evaluations on MOSEI/MELD, MSCOCO, and CC3M-500K show improved performance under perturbation and substantially reduced degradation under controlled monotone distortions, raw-pipeline drifts, and frozen-feature retrieval stress tests.