Exact, Fast and Expressive Poisson Point Processes via Squared Neural Families
Russell Tsuchida, Cheng Soon Ong, Dino Sejdinovic
Abstract
We introduce squared neural Poisson point processes (SNEPPPs) by parameterising the intensity function by the squared norm of a two layer neural network. When the hidden layer is fixed and the second layer has a single neuron, our approach resembles previous uses of squared Gaussian process or kernel methods, but allowing the hidden layer to be learnt allows for additional flexibility. In many cases of interest, the integrated intensity function admits a closed form and can be computed in quadratic time in the number of hidden neurons. We enumerate a far more extensive number of such cases than has previously been discussed. Our approach is more memory and time efficient than naive implementations of squared or exponentiated kernel methods or Gaussian processes. Maximum likelihood and maximum a posteriori estimates in a reparameterisation of the final layer of the intensity function can be obtained by solving a (strongly) convex optimisation problem using projected gradient descent. We demonstrate SNEPPPs on real, and synthetic benchmarks, and provide a software implementation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- On the Relationship Between Monotone and Squared Probabilistic CircuitsBenjie Wang, Guy Van den BroeckAAAI 2025 · 16 citations
- How to Square Tensor Networks and Circuits Without Squaring ThemLorenzo Loconte, Adrián Javaloy, Antonio VergariICLR 2026 · 6 citations
- K2IE: Kernel Method-based Kernel Intensity Estimators for Inhomogeneous Poisson ProcessesHideaki Kim, Tomoharu Iwata, Akinori FujinoICML 2025
Builds on5
- Neural Networks Fail to Learn Periodic Functions and How to Fix ItLiu Ziyin, Tilman Hartwig, Masahito UedaNeurIPS 2020 · 249 citations
- Non-parametric Models for Non-negative FunctionsUlysse Marteau-Ferey, Francis R. Bach, Alessandro RudiNeurIPS 2020 · 65 citations
- PSD Representations for Effective Probability ModelsAlessandro Rudi, Carlo CilibertoNeurIPS 2021 · 28 citations
- Fast Neural Kernel Embeddings for General ActivationsInsu Han, Amir Zandieh, Jaehoon Lee, Roman Novak et al.NeurIPS 2022 · 26 citations
- Fast Bayesian Estimation of Point Process Intensity as Function of CovariatesHideaki Kim, Taichi Asami, Hiroyuki TodaNeurIPS 2022 · 8 citations
Related papers
- Squared Neural Families: A New Class of Tractable Density ModelsRussell Tsuchida, Cheng Soon Ong, Dino SejdinovicNeurIPS 2023 · 15 citations
- Neural Jump-Diffusion Temporal Point ProcessesShuai Zhang, Chuan Zhou, Yang Aron Liu, Peng Zhang et al.ICML 2024 · 16 citations
- UNIPoint: Universally Approximating Point Processes IntensitiesAlexander Soen, Alexander Patrick Mathews, Daniel Grixti-Cheng, Lexing XieAAAI 2021 · 18 citations
- Neural Spatio-Temporal Point ProcessesRicky T. Q. Chen, Brandon Amos, Maximilian NickelICLR 2021 · 21 citations
- Automatic Integration for Spatiotemporal Neural Point ProcessesZihao Zhou, Rose YuNeurIPS 2023 · 18 citations
