vix.ing · top · new · best · stats · spec

Mitigating masked pixels in climate-critical datasets

2023/07/18 by Angelina Agabin, J. X. Prochaska, Agabin, Angelina +5
Earth and Planetary Sciences · Environmental Science · #Atmospheric and Oceanic Physics (physics.ao-ph) #Climate variability and models #FOS: Physical sciences #Meteorological Phenomena and Simulations #Oceanographic and Atmospheric Processes

paper · pdf · doi:10.48550/arxiv.2307.09227

openalex publication_date 2023/07/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Remote sensing observations of the Earth's surface are frequently stymied by clouds, water vapour, and aerosols in our atmosphere. These degrade or preclude the measurementof quantities critical to scientific and, hence, societal applications. In this study, we train a natural language processing (NLP) algorithm with high-fidelity ocean simulations in order to accurately reconstruct masked or missing data in sea surface temperature (SST)--i.e. one of 54 essential climate variables identified by the Global Climate Observing System. We demonstrate that the Enki model repeatedly outperforms previously adopted inpainting techniques by up to an order-of-magnitude in reconstruction error, while displaying high performance even in circumstances where the majority of pixels are masked. Furthermore, experiments on real infrared sensor data with masking fractions of at least 40% show reconstruction errors of less than the known sensor uncertainty (RMSE < ~0.1K). We attribute Enki's success to the attentive nature of NLP combined with realistic SST model outputs, an approach that may be extended to other remote sensing variables. This study demonstrates that systems built upon Enki--or other advanced systems like it--may therefore yield the optimal solution to accurate estimates of otherwise missing or masked parameters in climate-critical datasets sampling a rapidly changing Earth.

Related