Qualitative crop condition survey reveals spatiotemporal production patterns and allows early yield prediction

Large-scale continuous crop monitoring systems (CMS) are key to detect and manage agricultural production anomalies. Current CMS exploit meteorological and crop growth models, and satellite imagery, but have underutilized legacy sources of information such as operational crop expert surveys with long and uninterrupted records. We argue that crop expert assessments, despite their subjective and categorical nature, capture the complexities of assessing the "status" of a crop better than any model or remote sensing retrieval. This is because crop rating data naturally encapsulates the broad expert knowledge of many individual surveyors spread throughout the country, constituting a sophisticated network of "people as sensors" that provide consistent and accurate information on crop progress. We analyze data from the US Department of Agriculture (USDA) Crop Progress and Condition (CPC) survey between 1987 and 2019 for four major crops across the US, and show how to transform the original qualitative data into a continuous, probabilistic variable better suited to quantitative analysis. Although the CPC reflects the subjective perception of many surveyors at different locations, the underlying models that describe the reported crop status are statistically robust and maintain similar characteristics across different crops, exhibit long-term stability, and have nation-wide validity. We discuss the origin and interpretation of existing spatial and temporal biases in the survey data. Finally, we propose a quantitative Crop Condition Index based on the CPC survey and demonstrate how this index can be used to monitor crop status and provide earlier and more precise predictions of crop yields than official USDA forecasts released midseason.