Mineral Earth Sciences LLC

Deere + Company

X Development LLC

Bodi Yuan

Zhiqiang Yuan

Ming Zheng

Kangkang Wang

Elliott Grant

Lianghao Li

Hong Wu

Zihao Li

Implementations are directed to generating a stream of agricultural annotations with respect to area(s) of interest of an agricultural field, and providing the stream of agricultural annotations for presentation to the user in an augmented reality manner with respect to the area(s) of interest. In some implementations, a stream of vision data may be received at a first computing device of the user and from a second computing device of the user. Further, the first computing device may process the stream of vision data to generate the stream of agricultural annotations. Moreover, the first computing device may transmit the stream of agricultural annotations to the second computing device to cause the stream of agricultural annotations to be provided for presentation to the user. In other implementations, the first computing device may be omitted, and the second computing device may be utilized to generate the stream of agricultural annotations.

Method(s) and system(s) for enabling augmented reality scouting of an agricultural field

Techniques are described herein for using artificial intelligence to predict crop yields based on observational crop data. A method includes: obtaining a first digital image of at least one plant; segmenting the first digital image of the at least one plant to identify at least one seedpod in the first digital image; for each of the at least one seedpod in the first digital image: determining a color of the seedpod; determining a number of seeds in the seedpod; inferring, using one or more machine learning models, a moisture content of the seedpod based on the color of the seedpod; and estimating, based on the moisture content of the seedpod and the number of seeds in the seedpod, a weight of the seedpod; and predicting a crop yield based on the moisture content and the weight of each of the at least one seedpod.

Inferring moisture from color

Implementations are described herein for automatically labeling synthetic plant parts in synthetic training images, where the synthetic training images and corresponding labels can be used as training data for training machine learning models to detect, segment, and/or classify various parts of plants in digital images. In various implementations, a digital image may be obtained that captures an area. The synthetic training image may be generated to depict one or more three-dimensional synthetic plants in the area. In many implementations, a plant mask, identifying individual plants as a whole in the synthetic training image, as well as a part mask, uniquely identifying one or more parts of the synthetic plant models, can be overlaid on the synthetic training image to label the one or more parts of the synthetic plant models.

Generating labeled synthetic training data

Implementations are described herein for normalizing counts of plant-parts-of-interest detected in digital imagery to account for differences in spatial dimensions of plants, particularly plant heights. In various implementations, one or more digital images depicting a top of a first plant may be processed. The one or more digital images may have been acquired by a vision sensor carried over top of the first plant by a ground-based vehicle. Based on the processing: a distance of the vision sensor to the first plant may be estimated, and a count of visible plant-parts-of-interest that were captured within a field of view of the vision sensor may be determined. Based on the estimated distance, the count of visible plant-parts-of-interest may be normalized with another count of visible plant-parts-of-interest determined from one or more digital images capturing a second plant.

Normalizing counts of plant-parts-of-interest

Implementations are described herein for automatically generating quasi-realistic synthetic training images that are usable as training data for training machine learning models to perceive various types of plant traits in digital images. In various implementations, multiple labeled simulated images may be generated, each depicting simulated and labeled instance(s) of a plant having a targeted plant trait. In some implementations, the generating may include stochastically selecting features of the simulated instances of plants from a collection of plant assets associated with the targeted plant trait. The collection of plant assets may be obtained from ground truth digital image(s). In some implementations, the ground truth digital image(s) may depict real-life instances of plants having the target plant trait. The plurality of labeled simulated images may be processed using a trained generator model to generate a plurality of quasi-realistic synthetic training images, each depicting quasi-realistic and labeled instance(s) of the targeted plant trait.

Growing community of inventors

Sunnyvale, CA, United States of America

Bodi Yuan