Multimodal Machine Learning for Crop Yield Prediction in Precision Agriculture

Authors

  • Akshaya Uttekar
  • Dattatraya Kumbhar
  • Ashwini Kumbhar

Keywords:

Crop yield prediction, Deep learning, Machine learning, Multimodal data fusion, Precision agriculture, Remote sensing

Abstract

Increased focus on precise agricultural insurance, climate-risk management, food-security planning, and precision agriculture has led to a greater interest in accurate prediction of crop yield. The development of Earth observation, meteorological reanalysis, soil mapping, field sensing, and Machine Learning (ML) has moved yield forecasting beyond single-source statistical models to multimodal predictive models. This critical analysis covers the emerging trends in ML and Deep Learning (DL) to predict crop yields, with a particular focus on the combination of remote-sensing images, weather patterns, soil and topographical data, crop-management data, and crop-growth indicators. Random forest, gradient boosting, convolutional neural networks, recurrent networks, and hybrid process-ML are effective predictors in representative studies; however, reported performance is highly dependent on the type of crop, the scale of the spatial area, the quality of the data, representation of the features, and the approach to validation. The multimodal integration can be specifically beneficial due to the description of complementary aspects of the crop-production system by different data sources, but the mismatch in spatial resolution, uncertainty in ground truth, leakage of information, poor geographic transferability, and poor model interpretability are the critical issues. New directions are process-guided learning, explainable AI, transfer learning, foundation models, uncertainty-aware forecasting, and computationally efficient operational systems. Future developments should hence be assessed in both predictive accuracy and robustness, reproducibility, agronomic plausibility, and practical decision value.

References

J. H. Jeong et al., “Random Forests for Global and Regional Crop Yield Predictions,” PLOS ONE, vol. 11, no. 6, p. e0156571, June 2016.

D. B. Lobell, D. Thau, C. Seifert, E. Engle, and B. Little, “A scalable satellite-based crop yield mapper,” Remote Sensing of Environment, vol. 164, pp. 324–333, July 2015.

J. You, X. Li, M. Low, D. Lobell, and S. Ermon, “Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31, no. 1, Feb. 2017.

P. Muruganantham, S. Wibowo, S. Grandhi, N. H. Samrat, and N. Islam, “A Systematic Literature Review on Crop Yield Prediction with Deep Learning and Remote Sensing,” Remote Sensing, vol. 14, no. 9, p. 1990, Apr. 2022.

ECMWF, “ERA5-Land monthly averaged data from 1950 to present,” Copernicus.eu, June 2019.

L. Poggio et al., “SoilGrids 2.0: producing soil information for the globe with quantified spatial uncertainty,” SOIL, vol. 7, no. 1, pp. 217–240, June 2021.

M. Maimaitijiang, V. Sagan, P. Sidike, S. Hartling, F. Esposito, and F. B. Fritschi, “Soybean yield prediction from UAV using multimodal data fusion and deep learning,” Remote Sensing of Environment, vol. 237, p. 111599, Feb. 2020.

Y. Wang, Z. Zhang, L. Feng, Q. Du, and T. Runge, “Combining Multi-Source Data and Machine Learning Approaches to Predict Winter Wheat Yield in the Conterminous United States,” Remote Sensing, vol. 12, no. 8, p. 1232, Apr. 2020.

S. Khaki, L. Wang, and S. V. Archontoulis, “A CNN-RNN Framework for Crop Yield Prediction,” Frontiers in Plant Science, vol. 10, Jan. 2020.

M. Qiao et al., “Crop yield prediction from multi-spectral, multi-temporal remotely sensed imagery using recurrent 3D convolutional neural networks,” International Journal of Applied Earth Observation and Geoinformation, vol. 102, p. 102436, Oct. 2021.

P. Nevavuori, N. Narra, and T. Lipping, “Crop yield prediction with deep convolutional neural networks,” Computers and Electronics in Agriculture, vol. 163, p. 104859, Aug. 2019.

G. Perich et al., “Pixel-based yield mapping and prediction from Sentinel-2 using spectral indices and neural networks,” Field Crops Research, vol. 292, p. 108824, Jan. 2023.

J. Shook, T. Gangopadhyay, L. Wu, B. Ganapathysubramanian, S. Sarkar, and A. K. Singh, “Crop yield prediction integrating genotype and weather variables using deep learning,” PLOS ONE, vol. 16, no. 6, p. e0252402, June 2021.

P. Feng et al., “Dynamic wheat yield forecasts are improved by a hybrid approach using a biophysical model and machine learning technique,” Agricultural and Forest Meteorology, vol. 285–286, p. 107922, May 2020.

M. Shahhosseini, G. Hu, I. Huber, and S. V. Archontoulis, “Coupling machine learning and crop modeling improves crop yield prediction in the US Corn Belt,” Scientific Reports, vol. 11, no. 1, p. 1606, Jan. 2021.

D. Paudel, A. de Wit, H. Boogaard, D. Marcos, S. Osinga, and I. N. Athanasiadis, “Interpretability of deep learning models for crop yield forecasting,” Computers and Electronics in Agriculture, vol. 206, p. 107663, Mar. 2023.

Published

2026-09-17

How to Cite

Akshaya Uttekar, Dattatraya Kumbhar, & Ashwini Kumbhar. (2026). Multimodal Machine Learning for Crop Yield Prediction in Precision Agriculture. Journal of Big Data Analytics and Business Intelligence, 1–20. Retrieved from https://www.matjournals.net/engineering/index.php/JoBDABI/article/view/4127