From General to Specialized: The Need for Foundational Models in Agriculture
2025/07/07 by Nedungadi, Vishal, Xiong, Xingguo, Potze, Aike +4 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering
paper · doi:10.48550/arxiv.2507.05390
Abstract
Food security remains a global concern as population grows and climate change intensifies, demanding innovative solutions for sustainable agricultural productivity. Recent advances in foundation models have demonstrated remarkable performance in remote sensing and climate sciences, and therefore offer new opportunities for agricultural monitoring. However, their application in challenges related to agriculture-such as crop type mapping, crop phenology estimation, and crop yield estimation-remains under-explored. In this work, we quantitatively evaluate existing foundational models to assess their effectivity for a representative set of agricultural tasks. From an agricultural domain perspective, we describe a requirements framework for an ideal agricultural foundation model (CropFM). We then survey and compare existing general-purpose foundational models in this framework and empirically evaluate two exemplary of them in three representative agriculture specific tasks. Finally, we highlight the need for a dedicated foundational model tailored specifically to agriculture.
Citations
- MultiMAE Meets Earth Observation: Pre-training Multi-modal Multi-task Masked Autoencoders for Earth Observation Tasks
- A Bayesian hierarchical framework for fusion of remote sensing data: An example with solar-induced fluorescence
- Hybrid Phenology Modeling for Predicting Temperature Effects on Tree Dormancy
- AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalities
- On the Generalizability of Foundation Models for Crop Type Mapping
- Large Language Models and Foundation Models in Smart Agriculture: Basics, Opportunities, and Challenges
- Large language models can help boost food production, but be mindful of their risks
- Transfer learning in environmental remote sensing
- Scaling transformer neural networks for skillful and reliable medium-range weather forecasting
- GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Models
- Embedding-based Retrieval with LLM for Effective Agriculture Information Extracting from Unstructured Data
- Accurate medium-range global weather forecasting with 3D neural networks
- Lightweight, Pre-trained Transformers for Remote Sensing Timeseries
- Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning
- Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast
- SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery
- A weakly supervised framework for high-resolution crop yield forecasts
- FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators
- Early- and in-season crop type mapping without current-year ground truth: generating labels from historical information via a topology-based approach
- On the Opportunities and Risks of Foundation Models
- A meta-analysis of projected global food demand and population at risk of hunger for the period 2010–2050
- SoilGrids 2.0: producing soil information for the globe with quantified spatial uncertainty
- The ERA5 global reanalysis
- Using satellite imagery to understand and promote sustainable development
- End-to-End Learned Early Classification of Time Series for In-Season Crop Type Mapping
- VIIRS night-time lights
- The Number, Size, and Distribution of Farms, Smallholder Farms, and Family Farms Worldwide
- Design and optimisation of a large-area process-based model for annual crops
- WOFOST: a simulation model of crop production
Cited by
Related