Is Score Matching Suitable for Estimating Point Processes?
Haoqun Cao, Zizhuo Meng, Tianjun Ke, Feng Zhou
Abstract
Score matching estimators have gained widespread attention in recent years partly because they are free from calculating the integral of normalizing constant, thereby addressing the computational challenges in maximum likelihood estimation (MLE). Some existing works have proposed score matching estimators for point processes. However, this work demonstrates that the incompleteness of the estimators proposed in those works renders them applicable only to specific problems, and they fail for more general point processes. To address this issue, this work introduces the weighted score matching estimator to point processes. Theoretically, we prove the consistency of our estimator and establish its rate of convergence. Experimental results indicate that our estimator accurately estimates model parameters on synthetic data and yields results consistent with MLE on real data. In contrast, existing score matching estimators fail to perform effectively. Codes are publicly available at https://github.com/KenCao2007/WSM_TPP.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 285a9c2f-dfcf-4057-b345-7889b541ad02Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Transformer Hawkes ProcessSimiao Zuo, Haoming Jiang, Zichong Li, Tuo Zhao et al.ICML 2020 · 382 citations
- Self-Attentive Hawkes ProcessQiang Zhang, Aldo Lipani, Ömer Kirnap, Emine YilmazICML 2020 · 254 citations
- HYPRO: A Hybridly Normalized Probabilistic Model for Long-Horizon Prediction of Event SequencesSiqiao Xue, Xiaoming Shi, James Y. Zhang, Hongyuan MeiNeurIPS 2022 · 65 citations
- Autoregressive Score MatchingChenlin Meng, Lantao Yu, Yang Song, Jiaming Song et al.NeurIPS 2020 · 17 citations
- Integration-free Training for Spatio-temporal Multimodal Covariate Deep Kernel Point ProcessesYixuan Zhang, Quyu Kong, Feng ZhouNeurIPS 2023 · 10 citations
Related papers
- Beyond Point Prediction: Score Matching-based Pseudolikelihood Estimation of Neural Marked Spatio-Temporal Point ProcessZichong Li, Qunzhi Xu, Zhenghao Xu, Yajun Mei et al.ICML 2024 · 4 citations
- Provable benefits of score matchingChirag Pabbaraju, Dhruv Rohatgi, Anish Prasad Sevekari, Holden Lee et al.NeurIPS 2023 · 19 citations
- Nonparametric Score EstimatorsYuhao Zhou, Jiaxin Shi, Jun ZhuICML 2020 · 30 citations
- Particle Denoising Diffusion SamplerAngus Phillips, Hai-Dang Dau, Michael John Hutchinson, Valentin De Bortoli et al.ICML 2024 · 60 citations
- Statistical Efficiency of Score Matching: The View from IsoperimetryFrederic Koehler, Alexander Heckett, Andrej RisteskiICLR 2023 · 6 citations
