Accurate medium-range global weather forecasting with 3D neural networks
2023/07/05 by Kaifeng Bi, Lingxi Xie, Hengheng Zhang +3 · 241 citations
Earth and Planetary Sciences · Environmental Science · #Climate variability and models #Meteorological Phenomena and Simulations #Tropical and Extratropical Cyclones Research
paper · pdf · doi:10.1038/s41586-023-06185-3
openalex publication_date 2023/07/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31
Abstract
Abstract Weather forecasting is important for science and society. At present, the most accurate forecast system is the numerical weather prediction (NWP) method, which represents atmospheric states as discretized grids and numerically solves partial differential equations that describe the transition between those states 1 . However, this procedure is computationally expensive. Recently, artificial-intelligence-based methods 2 have shown potential in accelerating weather forecasting by orders of magnitude, but the forecast accuracy is still significantly lower than that of NWP methods. Here we introduce an artificial-intelligence-based method for accurate, medium-range global weather forecasting. We show that three-dimensional deep networks equipped with Earth-specific priors are effective at dealing with complex patterns in weather data, and that a hierarchical temporal aggregation strategy reduces accumulation errors in medium-range forecasting. Trained on 39 years of global data, our program, Pangu-Weather, obtains stronger deterministic forecast results on reanalysis data in all tested variables when compared with the world’s best NWP system, the operational integrated forecasting system of the European Centre for Medium-Range Weather Forecasts (ECMWF) 3 . Our method also works well with extreme weather forecasts and ensemble forecasts. When initialized with reanalysis data, the accuracy of tracking tropical cyclones is also higher than that of ECMWF-HRES.
Citations
Cited by
- Artificial intelligence-driven design of inorganic materials for biomedical applications
- Applications of Machine Learning and Artificial Intelligence in Tropospheric Ozone Research
- An Earth-System-Oriented View of the S2S Predictability of North American Weather Regimes
- Postprocessing East African Rainfall Forecasts Using a Generative Machine Learning Model
- The Case Against Climate Doom
- Land surface information from satellites boost near-surface temperature forecast skill
- Multi-scale Autoregressive Models are Laplacian, Discrete, and Latent Diffusion Models in Disguise
- Practical Quantum Advantage before Fault Tolerance via Quantum-Informed Machine Learning
- Hierarchical Testing of a Hybrid Machine Learning‐Physics Global Atmosphere Model
- Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather
- The Rise of AI in Weather and Climate Information and its Impact on Global Inequality
- AI-Based Regional Emulation for Kilometer-Scale Dynamical Downscaling
- FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks
- Evaluating Extreme Precipitation Forecasts: A Threshold-Weighted, Spatial Verification Approach for Comparing an AI Weather Prediction Model Against a High-Resolution NWP Model
- Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Models
- Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction
- A PDE-Informed Latent Diffusion Model for 2-m Temperature Downscaling
- Unlocking the benefits of transparent and reusable science for climate risk management
- A Review of End-to-End Precipitation Prediction Using Remote Sensing Data: from Divination to Machine Learning
- A Framework for Hybrid Physics-AI Coupled Ocean Models
- HPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systems
- Hierarchical Graph Networks for Accurate Weather Forecasting via Lightweight Training
- Learning Coupled Earth System Dynamics with GraphDOP
- Signature Kernel Scoring Rule: A Spatio-Temporal Diagnostic for Probabilistic Weather Forecasting
- Sensing Without Colocation: Operator-Based Virtual Instrumentation for Domains Beyond Physical Reach
- Cortical-SSM: A Deep State Space Model for EEG and ECoG Motor Imagery Decoding
- Assessing Monotone Dependence: Area Under the Curve Meets Rank Correlation
- OmniCast: A Masked Latent Diffusion Model for Weather Forecasting Across Time Scales
- Monitoring and Modeling the Soil‐Plant System Toward Understanding Soil Health
- Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transition
- AB-UPT for Automotive and Aerospace Applications
- RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion
- An Operational Deep Learning System for Satellite-Based High-Resolution Global Nowcasting
- Assessing the Geographic Generalization and Physical Consistency of Generative Models for Climate Downscaling
- Deploying Atmospheric and Oceanic AI Models on Chinese Hardware and Framework: Migration Strategies, Performance Optimization and Analysis
- PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstruction
- DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation space
- Prescribed-Basis Coefficient-to-Coefficient Neural Operator for Partial Differential Equations
- Adversarial Attacks on Downstream Weather Forecasting Models: Application to Tropical Cyclone Trajectory Prediction
- Evaluating the Shanghai Typhoon Model against State-of-the-Art Machine-Learning Weather Prediction Models: A Case Study for Typhoon Danas (2025)
- The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warming
- ARROW: An Adaptive Rollout and Routing Method for Global Weather Forecasting
- Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model
- Quantifying Very Extreme Precipitation and Temperature Using Huge Ensembles Generated by Machine Learning-based Climate Model Emulators
- GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulations
- Zeeman: A Deep Learning Regional Atmospheric Chemistry Transport Model
- Deep Learning Reconstruction of Tropical Cyclogenesis in the Western North Pacific from Climate Reanalysis Dataset
- Benchmarking atmospheric circulation variability in an AI emulator, ACE2, and a hybrid model, NeuralGCM
- Spatiotemporal Forecasting as Planning: A Model-Based Reinforcement Learning Approach with Generative World Models
- Zephyrus: An Agentic Framework for Weather Science
- Learning more physically realistic dynamics in machine-learning based weather forecasting with latent-space constraints
- Exploring Accuracy Law for Deep Time Series Forecasters: An Empirical Study
- Probability calibration for precipitation nowcasting
- Typhoon Tracks Regulated by Feedbacks of Fine-Scale Clouds to Environment
- A Synergistic Approach: Dynamics–AI Ensemble in Tropical Cyclone Forecasting
- Predictability Study of Weather and Climate Events Related to Artificial Intelligence Models
- A Weather Foundation Model for the Power Grid
- Using deep learning to generate key variables in global mitigation scenarios
- TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Experts
- PHASE: Physics-Integrated, Heterogeneity-Aware Surrogates for Scientific Simulations
- Model Training, Data Assimilation, and Forecast Experiments with a Hybrid Atmospheric Model that Incorporates Machine Learning
- Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Models
- Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
- VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations
- Differential-Integral Neural Operator for Long-Term Turbulence Forecasting
- Mesh Interpolation Graph Network for Dynamic and Spatially Irregular Global Weather Forecasting
- Graph-based Neural Space Weather Forecasting
- Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rollouts
- A Big Chill: Examining an Extremely Sharp Cold Front from Three Perspectives
- Simultaneous Emulation and Downscaling With Physically Consistent Deep Learning‐Based Regional Ocean Emulators
- Global Forecasting of Tropical Cyclone Intensity Using Neural Weather Models
- The Impact of Tropical Convective Heating on the Amundsen Sea Low in a Deep-Learning Weather Forecasting Model
- Climate-Adaptive and Cascade-Constrained Machine Learning Prediction for Sea Surface Height under Greenhouse Warming
- Technical overview and architecture of the FastNet Machine Learning weather prediction model, version 1.0
- FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design
- Key role of the Madden-Julian Oscillation on tropical and subtropical humid heat and heatwaves
- An AutoML Framework using AutoGluonTS for Forecasting Seasonal Extreme Temperatures
- Communications to Circulations: Real-Time 3D Wind Field Prediction Using 5G GNSS Signals and Deep Learning
- STCast: Adaptive Boundary Alignment for Global and Regional Weather Forecasting
- A data-driven global ocean forecasting model with sub-daily and eddy-resolving resolution
- DPSformer: A long-tail-aware model for improving heavy rainfall prediction
- Accurate typhoon intensity forecasts using a non-iterative spatiotemporal transformer model
- FlowCast-ODE: Continuous Hourly Weather Forecasting with Dynamic Flow Matching and ODE Solver
- AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictions
- FusionMAE: large-scale pretrained model to optimize and simplify diagnostic and control of fusion plasma
- SamudrACE: Fast and Accurate Coupled Climate Modeling with 3D Ocean and Atmosphere Emulators
- Data-Efficient Ensemble Weather Forecasting with Diffusion Models
- Knowledge-Guided Adaptive Mixture of Experts for Precipitation Prediction
- Two ways to knowledge?
- How does an AI Weather Model Learn to Forecast Extreme Weather?
- Breaking the Statistical Similarity Trap in Extreme Convection Detection
- Intelligent Shanghai Typhoon Model (ISTM): A generative probabilistic emulator for typhoon hybrid modeling
- S2Transformer: Scalable Structured Transformers for Global Station Weather Forecasting
- Seasonal forecasting using the GenCast probabilistic machine learning model
- Data-driven solar forecasting enables near-optimal economic decisions
- Select, then Balance: Exploring Exogenous Variable Modeling of Spatio-Temporal Forecasting
- Finetuning AI Foundation Models to Develop Subgrid-Scale Parameterizations: A Case Study on Atmospheric Gravity Waves
- LUCIE-3D: A three-dimensional climate emulator for forced responses
- MAUSAM: An Observations-focused assessment of Global AI Weather Prediction Models During the South Asian Monsoon
- FuXi-TC: A generative framework integrating deep learning and physics-based models for improved tropical cyclone forecasts
- From Noise to Precision: A Diffusion-Driven Approach to Zero-Inflated Precipitation Prediction
- DeepSeasons: a Deep Learning scale-selecting approach to Seasonal Forecasts
- Post-processing of ensemble photovoltaic power forecasts with distributional and quantile regression methods
- Automated discovery of finite volume schemes using Graph Neural Networks
- Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Events
- Huracan: A skillful end-to-end data-driven system for ensemble data assimilation and weather prediction
- Learning from nature: insights into GraphDOP's representations of the Earth System
- GEN2: A Generative Prediction-Correction Framework for Long-time Emulations of Spatially-Resolved Climate Extremes
- MedFormer: a data-driven model for forecasting the Mediterranean Sea
- A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction
- Incoherent Light-Driven Nonlinear Optical Extreme Learner via Data Reverberation
- Lightning Prediction under Uncertainty: DeepLight with Hazy Loss
- Nonparametric Reaction Coordinate Optimization with Histories: A Framework for Rare Event Dynamics
- Large Model Driven Solar Activity AI Forecaster: A Scalable Dual Data-Model Framework
- MeteorPred: A Meteorological Multimodal Large Model and Dataset for Severe Weather Event Prediction
- Discovery Learning accelerates battery design evaluation
- Diffeomorphic Neural Operator Learning
- Enhanced climate reproducibility testing with false discovery rate correction
- FeDaL: Federated Dataset Learning for Time Series Foundation Models
- SolarSeer: Ultrafast and accurate 24-hour solar irradiance forecasts outperforming numerical weather prediction across the USA
- JustDense: Just using Dense instead of Sequence Mixer for Time Series analysis
- DMSC: Dynamic Multi-Scale Coordination Framework for Time Series Forecasting
- Flow Matching for Probabilistic Learning of Dynamical Systems from Missing or Noisy Data
- PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models
- A Deep Learning Earth System Model for Efficient Simulation of the Observed Climate
- OKG-LLM: Aligning Ocean Knowledge Graph with Observation Data via LLMs for Global Sea Surface Temperature Prediction
- Data-driven global ocean model resolving ocean-atmosphere coupling dynamics
- Physics-constrained generative machine learning-based high-resolution downscaling of Greenland's surface mass balance and surface temperature
- DualSG: A Dual-Stream Explicit Semantic-Guided Multivariate Time Series Forecasting Framework
- Towards White-Box Deep Wireless Sensing
- AtmosMJ: Revisiting Gating Mechanism for AI Weather Forecasting Beyond the Year Scale
- Extreme Solar Storm Reveals Causal Interactions in Space Weather
- Quantum-Informed Machine Learning for Predicting Spatiotemporal Chaos
- Low-rank adaptive physics-informed HyperDeepONets for solving differential equations
- A comparison of stretched-grid and limited-area modelling for data-driven regional weather forecasting
- Global weather forecasting through deep learning: applications and challenges
- FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale
- MVAR: MultiVariate AutoRegressive Air Pollutants Forecasting Model
- Role of Artificial Intelligence in Scientific Research: Classification Framework and Empirical Insights
- Multivariate Long-term Time Series Forecasting with Fourier Neural Filter
- EPT-2 Technical Report
- Controllable Patching for Compute-Adaptive Surrogate Modeling of Partial Differential Equations
- XiChen: A global weather observation-to-forecast machine learning system via four-dimensional variational gradient-guided flexible assimilation
- BioAnalyst: A Foundation Model for Biodiversity
- Intraseasonal Equatorial Kelvin and Rossby Waves in Modern AI-ML Models
- Mathematical artificial data for operator learning
- TerraNova: A Foundation Model for the Anthropocene
- From General to Specialized: The Need for Foundational Models in Agriculture
- SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications
- Deep Learning Atmospheric Models Reliably Simulate Out-of-Sample Land Heat and Cold Wave Frequencies
- Transparent Machine Learning: Training and Refining an Explainable Boosting Machine to Identify Overshooting Tops in Satellite Imagery
- Data and Code for Efficient Kilometer-Scale Precipitation Downscaling with Conditional Wavelet Diffusion
- Accurate Mediterranean Sea forecasting via graph-based deep learning
- Imposing the Fundamental Dynamical Constraint of Hydrostatic Balance to Improve Global ML Weather Prediction
- Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
- Probing forced responses and causality in data-driven climate emulators: conceptual limitations and the role of reduced-order models
- TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysis
- ITFormer: Bridging Time Series and Natural Language for Multi-Modal QA with Large-Scale Multitask Dataset
- Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics
- Foundation Model Empowered Synesthesia of Machines (SoM): AI-native Intelligent Multi-Modal Sensing-Communication Integration
- Aethorix v1.0: An Integrated Scientific AI Agent for Scalable Inorganic Materials Innovation and Industrial Implementation
- Artificial Intelligence for Atmospheric Sciences: A Research Roadmap
- A Survey of Physics-Informed AI for Complex Urban Systems
- High computational density nanophotonic media for machine learning inference
- Projecting U.S. coastal storm surge risks and impacts with deep learning
- A Hierarchical Spatial Transformer for Massive Point Samples in Continuous Space
- PeakWeather: MeteoSwiss Weather Station Measurements for Spatiotemporal Deep Learning
- Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting
- Forecast error diagnostics in neural weather models
- Holistic approach and Advanced Color Singlet Identification for physics measurements at high energy frontier
- Arnoldi Singular Vector perturbations for machine learning weather prediction
- Constructing Extreme Heatwave Storylines with Differentiable Climate Models
- Causal Climate Emulation with Bayesian Filtering
- WISCA: A Consensus-Based Approach to Harmonizing Interpretability in Tabular Datasets
- Probabilistic measures afford fair comparisons of AIWP and NWP model output
- A machine learning model for skillful climate system prediction
- Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Review
- Deep Learning Weather Models for Subregional Ocean Forecasting: A Case Study on the Canary Current Upwelling System
- Exploring Design Choices for Autoregressive Deep Learning Climate Models
- Non-collective Calibrating Strategy for Time Series Forecasting
- Improving Time Series Forecasting via Instance-aware Post-hoc Revision
- BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning
- RiverMamba: A State Space Model for Global River Discharge and Flood Forecasting
- Ocean-E2E: Hybrid Physics-Based and Data-Driven Global Forecasting of Extreme Marine Heatwaves with End-to-End Neural Assimilation
- Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences
- NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation
- PIPE: Physics-Informed Position Encoding for Alignment of Satellite Images and Time Series
- FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulation
- Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias
- From Proxies to Fields: Spatiotemporal Reconstruction of Global Radiation from Sparse Sensor Sequences
- PEAR: Equal Area Weather Forecasting on the Sphere
- TimeCF: A TimeMixer-Based Model with adaptive Convolution and Sharpness-Aware Minimization Frequency Domain Loss for long-term time seris forecasting
- Sparse Diffusion Autoencoder for Test-time Adapting Prediction of Complex Systems
- Time-o1: Time-Series Forecasting Needs Transformed Label Alignment
- Large Language models for Time Series Analysis: Techniques, Applications, and Challenges
- Artificial intelligence to support cross-disciplinary climate change research
- Generative Adaptation of Dynamics to Environmental Shifts via Weight-space Diffusion
- Collaboration between artificial intelligence and Earth science communities for mutual benefit
- LaPON: A Lagrange's-mean-value-theorem-inspired operator network for solving PDEs and its application on NSE
- FABLE: A Localized, Targeted Adversarial Attack on Weather Forecasting Models
- FlashBias: Fast Computation of Attention with Bias
- Attention on the Sphere
- Improving Medium Range Severe Weather Prediction through Transformer Post-processing of AI Weather Forecasts
- LanTu: Dynamics-Enhanced Deep Learning for Eddy-Resolving Ocean Forecasting
- Predicting Beyond Training Data via Extrapolation versus Translocation: AI Weather Models and Dubai's Unprecedented 2024 Rainfall
- RainPro-8: An Efficient Deep Learning Model to Estimate Rainfall Probabilities Over 8 Hours
- LatticeVision: Image to Image Networks for Modeling Non-Stationary Spatial Data
- ExEBench: Benchmarking Foundation Models on Extreme Earth Events
- Climate in a Bottle: Towards a Generative Foundation Model for the Kilometer-Scale Global Atmosphere
- From AI Weather Prediction to Infrastructure Resilience: A Real-Time Correction-Downscaling Framework for Tropical Cyclone Impact Forecasting
- IRNN: Innovation-driven Recurrent Neural Network for Time-Series Data Modeling and Prediction
- SPIN-ODE: Stiff Physics-Informed Neural ODE for Chemical Reaction Rate Estimation
- Physics-Assisted and Topology-Informed Deep Learning for Weather Prediction
- AIFS-DOP: End-to-End Medium-Range Weather Prediction from Observations Alone with Machine Learning
- U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecaster
- Towards Fair Comparisons of AI- and Physics-Based Weather Models for Extreme Events via the Weighted Potential CRPS
- Exascale Hybrid Numerical-AI Ensembles for Operational Flood-Season Forecasting in East Asia: 15-km Decadal Hindcasts and 1-km High-Resolution Capability
- Advancing Seasonal Prediction of Tropical Cyclone Activity with a Hybrid AI-Physics Climate Model
- Machine Learning (ML)-Physics Fusion Model Outperforms Both Physics-Only and ML-Only Models in Typhoon Predictions
- Quantifying the Influence of Climate on Storm Activity Using Machine Learning
- Atmospheric Predictability Beyond 30 Days with Machine Learning
- Mjölnir: A Deep Learning Parametrization Framework for Global Lightning Flash Density
- Letting the neural code speak: Automated characterization of monkey visual neurons through human language
- Error in ERA5 2m Temperature identified using GraphCast
- BiXiao: An AI-Based Atmospheric Environment Forecasting Model Using Discontinuous Grids
- Global Climate Model Bias Correction Using Deep Learning
- Passive All-Optical Nonlinear Neuron Activation via PPLN Nanophotonic Waveguides
- Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulations
- Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generation
- Democracy of AI Numerical Weather Models: An Example of Global Forecasting with FourCastNetv2 Made by a University Research Lab Using GPU
- EnsAI: An Emulator for Atmospheric Chemical Ensembles
- How to systematically develop an effective AI-based bias correction model?
- Evaluating Temporal Plasticity in Foundation Time Series Models for Incremental Fine-tuning
- Temporal Bridges for Spatial Resolution: Enhancing Climate Data Super-Resolution with Bidirectional Alignment
- Dynamical errors in machine learning forecasts
- Air Quality Prediction with A Meteorology-Guided Modality-Decoupled Spatio-Temporal Network
- A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science
- TianQuan-S2S: A Subseasonal-to-Seasonal Global Weather Model via Incorporate Climatology State
- A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook
- Hallucination, reliability, and the role of generative AI in science
- A Mechanism-Learning Deeply Coupled Model for Remote Sensing Retrieval of Global Land Surface Temperature
- KunPeng: A Global Ocean Environmental Model
Related