Resolving Extreme Data Scarcity by Explicit Physics Integration: An Application to Groundwater Heat Transport

2025/07/08 by Julia Pelzer, Pelzer, Julia, Corné Verburg +5 · 1 citation
Energy · Engineering · Physics and Astronomy · #Distributed #FOS: Computer and information sciences #Geothermal Energy Systems and Applications #Integrated Energy Systems Optimization #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Parallel #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2507.06062

openalex publication_date 2025/07/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31

Abstract

Real-world flow applications in complex scientific and engineering domains, such as geosciences, challenge classical simulation methods due to large spatial domains, high spatio-temporal resolution requirements, and potentially strong material heterogeneities that lead to ill-conditioning and long runtimes. While machine learning-based surrogate models can reduce computational cost, they typically rely on large training datasets that are often unavailable in practice. To address data-scarce settings, we revisit the structure of advection-diffusion problems and decompose them into multiscale processes of locally and globally dominated components, separating spatially localized interactions and long-range effects. We propose a Local-Global Convolutional Neural Network (LGCNN) that combines a lightweight numerical model for global transport with two convolutional neural networks addressing processes of a more local nature. We demonstrate the performance of our method on city-scale geothermal heat pump interaction modeling and show that, even when trained on fewer than five simulations, LGCNN generalizes to arbitrarily larger domains, and can be successfully transferred to real subsurface parameter maps from the Munich region, Germany.

Citations

• A Staged Deep Learning Approach to Spatial Refinement in 3D Temporal Atmospheric Transport
• Neural Operators with Localized Integral and Differential Kernels
• Learning the solution operator of two-dimensional incompressible Navier-Stokes equations using physics-aware convolutional neural networks
• PDEBENCH: An Extensive Benchmark for Scientific Machine Learning
• Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's next
• Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
• U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flow
• U-FNO—An enhanced Fourier neural operator-based deep-learning model for multiphase flow
• Machine Learning: Algorithms, Real-World Applications and Research Directions
• Fourier Neural Operator for Parametric Partial Differential Equations
• How Much Position Information Do Convolutional Neural Networks Encode?
• Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modeling
• Optuna: A Next-generation Hyperparameter Optimization Framework
• Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data
• Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Deep Learning Methods for Reynolds-Averaged Navier–Stokes Simulations of Airfoil Flows
• UNet++: A Nested U-Net Architecture for Medical Image Segmentation
• U-Net: Convolutional Networks for Biomedical Image Segmentation
• Image quality assessment: from error visibility to structural similarity
• Artificial neural networks for solving ordinary and partial differential equations

Cited by

• Domain-Decomposed Graph Neural Network Surrogate Modeling for Ice Sheets

Related

• Deep learning based surrogate modeling for thermal plume prediction of groundwater heat pumps
• A Deep Learning Approach for Thermal Plume Prediction of Groundwater Heat Pumps
• Application of Machine Learning Methods in Inferring Surface Water Groundwater Exchanges using High Temporal Resolution Temperature Measurements
• Multi-scale Digital Twin: Developing a fast and physics-informed surrogate model for groundwater contamination with uncertain climate models
• Surrogate Optimization of Deep Neural Networks for Groundwater Predictions