Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization
Michal Balcerak, Tamaz Amiranashvili, Andreas Wagner, Jonas Weidner, Petr Karnakov, Johannes C. Paetzold, Ivan Ezhov, Petros Koumoutsakos, Benedikt Wiestler, Bjoern H. Menze
Abstract
Physical models in the form of partial differential equations serve as important priors for many under-constrained problems. One such application is tumor treatment planning, which relies on accurately estimating the spatial distribution of tumor cells within a patient's anatomy. While medical imaging can detect the bulk of a tumor, it cannot capture the full extent of its spread, as low-concentration tumor cells often remain undetectable, particularly in glioblastoma, the most common primary brain tumor. Machine learning approaches struggle to estimate the complete tumor cell distribution due to a lack of appropriate training data. Consequently, most existing methods rely on physics-based simulations to generate anatomically and physiologically plausible estimations. However, these approaches face challenges with complex and unknown initial conditions and are constrained by overly rigid physical models. In this work, we introduce a novel method that integrates data-driven and physics-based cost functions, akin to Physics-Informed Neural Networks (PINNs). However, our approach parametrizes the solution directly on a dynamic discrete mesh, allowing for the effective modeling of complex biomechanical behaviors. Specifically, we propose a unique discretization scheme that quantifies how well the learned spatiotemporal distributions of tumor and brain tissues adhere to their respective growth and elasticity equations. This quantification acts as a regularization term, offering greater flexibility and improved integration of patient data compared to existing models. We demonstrate enhanced coverage of tumor recurrence areas using real-world data from a patient cohort, highlighting the potential of our method to improve model-driven treatment planning for glioblastoma in clinical practice.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 920ba0bd-9082-4e60-9b98-7d341f1fe1feCited by top-tier papers1
Ask how each one uses itBuilds on9
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Characterizing possible failure modes in physics-informed neural networksAditi S. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M. Kirby et al.NeurIPS 2021 · 1,421 citations
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields ReconstructionCheng Sun, Min Sun, Hwann-Tzong ChenCVPR 2022 · 859 citations
- Separable Physics-Informed Neural NetworksJunwoo Cho, Seungtae Nam, Hyunmo Yang, Seok-Bae Yun et al.NeurIPS 2023 · 138 citations
- Accelerated Training of Physics-Informed Neural Networks (PINNs) using Meshless DiscretizationsRamansh Sharma, Varun ShankarNeurIPS 2022 · 81 citations
Related papers
- PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systemsBocheng Zeng, Qi Wang, Mengtao Yan, Yang Liu et al.ICLR 2025
- PhysGNN: A Physics-Driven Graph Neural Network Based Model for Predicting Soft Tissue Deformation in Image-Guided NeurosurgeryYasmin Salehi, Dennis GiannacopoulosNeurIPS 2022 · 54 citations
- Improved Training of Physics-Informed Neural Networks Using Energy-Based Priors: a Study on Electrical Impedance TomographyAkarsh Pokkunuru, Pedram Rooshenas, Thilo Strauss, Anuj Abhishek et al.ICLR 2023
- Space and time continuous physics simulation from partial observationsSteeven Janny, Madiha Nadri, Julie Digne, Christian WolfICLR 2024 · 10 citations
- DMIS: Dynamic Mesh-Based Importance Sampling for Training Physics-Informed Neural NetworksZijiang Yang, Zhongwei Qiu, Dongmei FuAAAI 2023 · 19 citations
