ICML2024

Clifford-Steerable Convolutional Neural Networks

Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forré

29 citations

Abstract

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of E(p,q)\mathrm{E}(p, q)-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces Rp,q\mathbb{R}^{p,q}. They cover, for instance, E(3)\mathrm{E}(3)-equivariance on R3\mathbb{R}^3 and Poincaré-equivariance on Minkowski spacetime R1,3\mathbb{R}^{1,3}. Our approach is based on an implicit parametrization of O(p,q)\mathrm{O}(p,q)-steerable kernels via Clifford group equivariant neural networks. We significantly and consistently outperform baseline methods on fluid dynamics as well as relativistic electrodynamics forecasting tasks.