WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting

2020/08/27 by Stephan Rasp, Peter D. Dueben, Sebastian Scher +3 · 40 citations
Earth and Planetary Sciences · Environmental Science · #Meteorological Phenomena and Simulations #Climate variability and models #Hydrological Forecasting Using AI

paper · pdf · doi:10.1029/2020ms002203

openalex created_date 2020/02/07 · openalex publication_date 2020/08/27 · openalex updated_date 2026/07/29

Abstract

Abstract Data‐driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data‐driven methods could also be used to predict global weather patterns days in advance. First studies show promise but the lack of a common data set and evaluation metrics make intercomparison between studies difficult. Here we present a benchmark data set for data‐driven medium‐range weather forecasting (specifically 3–5 days), a topic of high scientific interest for atmospheric and computer scientists alike. We provide data derived from the ERA5 archive that has been processed to facilitate the use in machine learning models. We propose simple and clear evaluation metrics which will enable a direct comparison between different methods. Further, we provide baseline scores from simple linear regression techniques, deep learning models, as well as purely physical forecasting models. The data set is publicly available at https://github.com/pangeo‐data/WeatherBench and the companion code is reproducible with tutorials for getting started. We hope that this data set will accelerate research in data‐driven weather forecasting.

Cited by

• Learning skillful medium-range global weather forecasting
• Applications of Machine Learning and Artificial Intelligence in Tropospheric Ozone Research
• Land surface information from satellites boost near-surface temperature forecast skill
• Practical Quantum Advantage before Fault Tolerance via Quantum-Informed Machine Learning
• Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather
• The Rise of AI in Weather and Climate Information and its Impact on Global Inequality
• The Benchmarking Epistemology: Construct Validity for Evaluating Machine Learning Models
• A Review of End-to-End Precipitation Prediction Using Remote Sensing Data: from Divination to Machine Learning
• LO-SDA: Latent Optimization for Score-based Atmospheric Data Assimilation
• Error bounded compression for weather and climate applications
• Hierarchical Graph Networks for Accurate Weather Forecasting via Lightweight Training
• Chronos-2: From Univariate to Universal Forecasting
• Signature Kernel Scoring Rule: A Spatio-Temporal Diagnostic for Probabilistic Weather Forecasting
• Assessing Monotone Dependence: Area Under the Curve Meets Rank Correlation
• OmniCast: A Masked Latent Diffusion Model for Weather Forecasting Across Time Scales
• Deploying Atmospheric and Oceanic AI Models on Chinese Hardware and Framework: Migration Strategies, Performance Optimization and Analysis
• GLOFNet -- A Multimodal Dataset for GLOF Monitoring and Prediction
• KAIROS: Unified Training for Universal Non-Autoregressive Time Series Forecasting
• Artificial intelligence as a surrogate brain: Bridging neural dynamical models and data
• ARROW: An Adaptive Rollout and Routing Method for Global Weather Forecasting
• Spatiotemporal Forecasting as Planning: A Model-Based Reinforcement Learning Approach with Generative World Models
• Machine Learning Workflows in Climate Modeling: Design Patterns and Insights from Case Studies
• Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Models
• Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
• Information Bottleneck Learning for Faithful Time Series Forecasting Explanations
• Global Forecasting of Tropical Cyclone Intensity Using Neural Weather Models
• Physics-informed machine learning: case studies for weather and climate modelling
• TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise Decoding
• FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design
• Accurate typhoon intensity forecasts using a non-iterative spatiotemporal transformer model
• AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictions
• Data-Efficient Ensemble Weather Forecasting with Diffusion Models
• Can deep learning beat numerical weather prediction?
• Accurate medium-range global weather forecasting with 3D neural networks
• PIANO: Physics Informed Autoregressive Network
• IndiaWeatherBench: A Dataset and Benchmark for Data-Driven Regional Weather Forecasting over India
• Enhanced climate reproducibility testing with false discovery rate correction
• Operational convection-permitting COSMO/ICON ensemble predictions at observation sites (CIENS)
• CauKer: Classification Time Series Foundation Models Can Be Pretrained on Synthetic Data
• Flow Matching for Probabilistic Learning of Dynamical Systems from Missing or Noisy Data

Related

• WeatherBench 2: A benchmark for the next generation of data-driven global weather models
• On some limitations of data-driven weather forecasting models
• RainBench: Towards Global Precipitation Forecasting from Satellite Imagery
• Deep Learning and Foundation Models for Weather Prediction: A Survey
• EWMoE: An effective model for global weather forecasting with mixture-of-experts