MNO : A Multi-modal Neural Operator for Parametric Nonlinear BVPs

2025/07/16 by Vamshi C. Madala, Madala, Vamshi C., Nithin Govindarajan +3
Computer Science · Engineering · #Advanced Algorithms and Applications #Advanced Sensor and Control Systems #Computational Engineering #FOS: Computer and information sciences #Finance #Fuzzy Logic and Control Systems #and Science (cs.CE)

paper · pdf · doi:10.48550/arxiv.2507.11870

openalex publication_date 2025/07/16 · openalex created_date 2025/10/14 · openalex updated_date 2026/07/28

Abstract

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or source terms independently to the solution, limiting their flexibility and applicability. In contrast, our proposed MNO architecture generalizes these approaches by mapping multiple parameters including PDE coefficients, source terms, and boundary conditions to the solution space in a unified manner. Our MNO is motivated by the hierarchical nested bases of the Fast Multipole Method (FMM) and is constructed systematically through three key components: a parameter efficient Generalized FMM (GFMM) block, a Unimodal Neural Operator (UNO) built upon GFMM blocks for single parameter mappings, and most importantly, a multimodal fusion mechanism extending these components to learn the joint map. We demonstrate the multimodal generalization capacity of our approach on both linear and nonlinear BVPs. Our experiments show that the network effectively handles simultaneous variations in PDE coefficients and source or boundary terms.

Citations

• Paving the way for scientific foundation models: enhancing generalization and robustness in PDEs with constraint-aware pre-training
• A Review of Neural Network Solvers for Second-order Boundary Value Problems
• UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation
• Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning
• Transolver: A Fast Transformer Solver for PDEs on General Geometries
• NSNO: Neumann Series Neural Operator for Solving Helmholtz Equations in Inhomogeneous Medium
• BENO: Boundary-embedded Neural Operators for Elliptic PDEs
• Generating synthetic data for neural operators
• Beginner's guide to Aggregation-Diffusion Equations
• Multi-level Neural Networks for Accurate Solutions of Boundary-Value Problems
• Group Equivariant Fourier Neural Operators for Partial Differential Equations
• GNOT: A General Neural Operator Transformer for Operator Learning
• Convolutional Neural Operators for robust and accurate learning of PDEs
• FMM-Net: neural network architecture based on the Fast Multipole Method
• FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators
• Multiwavelet-based Operator Learning for Differential Equations
• Learning the solution operator of parametric partial differential equations with physics-informed DeepOnets
• Learning the solution operator of parametric partial differential equations with physics-informed DeepONets
• Fourier Neural Operator for Parametric Partial Differential Equations
• Multipole Graph Neural Operator for Parametric Partial Differential Equations
• Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
• Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks
• Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• A multiscale neural network based on hierarchical nested bases
• PDE-Net: Learning PDEs from Data
• Attention Is All You Need
• Benefits of depth in neural networks
• U-Net: Convolutional Networks for Biomedical Image Segmentation
• Adam: A Method for Stochastic Optimization

Related

• MgNO: Efficient Parameterization of Linear Operators via Multigrid
• PINO-MBD: Physics-informed Neural Operator for Solving Coupled ODEs in Multi-body Dynamics
• Physics-Informed Neural Networks and Neural Operators for Parametric PDEs
• A multiscale neural network based on hierarchical nested bases
• MgFNO: Multi-grid Architecture Fourier Neural Operator for Parametric Partial Differential Equations