A Functional Extension of Semi-Structured Networks
David Rügamer, Bernard X. W. Liew, Zainab Altai, Almond Stöcker
Abstract
Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A significant challenge in this integration is maintaining the interpretability of the additive model component. Inspired by large-scale biomechanics datasets, this paper explores extending SSNs to functional data. Existing methods in functional data analysis are promising but often not expressive enough to account for all interactions and non-linearities and do not scale well to large datasets. Although the SSN approach presents a compelling potential solution, its adaptation to functional data remains complex. In this work, we propose a functional SSN method that retains the advantageous properties of classical functional regression approaches while also improving scalability. Our numerical experiments demonstrate that this approach accurately recovers underlying signals, enhances predictive performance, and performs favorably compared to competing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d3b08fa6-c1d5-4f19-bb1d-bf83423e6b94Builds on6
- Neural Additive Models: Interpretable Machine Learning with Neural NetsRishabh Agarwal, Levi Melnick, Nicholas Frosst, Xuezhou Zhang et al.NeurIPS 2021 · 663 citations
- NODE-GAM: Neural Generalized Additive Model for Interpretable Deep LearningChun-Hao Chang, Rich Caruana, Anna GoldenbergICLR 2022 · 114 citations
- Neural Basis Models for InterpretabilityFilip Radenovic, Abhimanyu Dubey, Dhruv MahajanNeurIPS 2022 · 82 citations
- Change-point Detection for Sparse and Dense Functional Data in General DimensionsCarlos Misael Madrid Padilla, Daren Wang, Zifeng Zhao, Yi YuNeurIPS 2022 · 16 citations
- A New PHO-rmula for Improved Performance of Semi-Structured NetworksDavid RügamerICML 2023 · 11 citations
Related papers
- Functional Neural Networks: Shift invariant models for functional data with applications to EEG classificationFlorian Heinrichs, Mavin Heim, Corinna WeberICML 2023 · 12 citations
- Directed Semi-Simplicial Learning with Applications to Brain Activity DecodingManuel Lecha, Andrea Cavallo, Francesca Dominici, Ran Levi et al.ICLR 2026 · 2 citations
- Sparse Bayesian Deep Functional Learning with Structured Region SelectionXiaoxian Zhu, Yingmeng Li, Shuangge Ma, Mengyun WuICML 2026
- Deep Neural Network Regression with Functional CovariatesHang Zhou, Ju-Sheng Hong, Xiucai Ding, Jane-Ling WangICML 2026
- Sparse Interaction Additive Networks via Feature Interaction Detection and Sparse SelectionJames Enouen, Yan LiuNeurIPS 2022 · 38 citations
