The Climate Corporation

Yichuan Gui

Wei Guan

A computer system is provided comprising a classification model management server computer configured, by instructions, to: receive a new image from a user device; apply a first digital model to first regions within the new image for classifying each of the first regions into a particular class; apply a second digital model to second regions within the new image for classifying each of the second regions into a particular class; and transmit classification data related to the class of the first regions and the class of the second regions to the user device. In connection therewith, the second regions each generally correspond to a combination of multiple first regions.

Detection of plant diseases with multi-stage, multi-scale deep learning

A system and processing methods for configuring and utilizing a convolutional neural network (CNN) for plant disease recognition are disclosed. In some embodiments, the system is programmed to collect photos of infected plants or leaves where regions showing symptoms of infecting diseases are marked. Each photo may have multiple marked regions. Depending on how the symptoms are sized or clustered, one marked region may include only one lesion caused by one disease, while another may include multiple, closely-spaced lesions caused by one disease. The system is programmed to determine anchor boxes having distinct aspect ratios from these marked regions for each convolutional layer of a single shot multibox detector (SSD). For certain types of plants, common diseases lead to relatively many aspect ratios, some having relatively extreme values. The system is programmed to then train the SSD using the marked regions and the anchor boxes and apply the SSD to new photos to identify diseased plants.

Detecting infection of plant diseases by classifying plant photos

In some embodiments, a computer-implemented method is disclosed. The method comprises receiving a plant image from a user device and applying a first digital model to first regions within the image for classifying each of the first regions into a class of a first set of classes corresponding to a first plurality of plant diseases, a healthy condition, or a combination of a second plurality of plant diseases. The method also includes applying a second digital model to one or more second regions within the image for classifying each of the one or more second regions into a class of a second set of classes corresponding to the second plurality of plant diseases. The method then includes transmitting classification data related to the classes of the first set of classes and the classes of the second set of classes to the user device into which the regions are classified.

In some embodiments, a computer-implemented method is disclosed. The method comprises obtaining a first digital model for classifying an image into a class of a first set of classes corresponding to a first plurality of plant diseases, a healthy condition, or a combination of a second plurality of plant diseases; obtaining a second digital model for classifying an image into a class of a second set of classes corresponding to the second plurality of plant diseases; receiving a new image from a user device; applying the first digital model to a plurality of first regions within the new image to obtain a plurality of classifications; applying the second digital model to one or more second regions, each corresponding to a combination of multiple first regions of the plurality of first regions, to obtain one or more classifications, the multiple first regions being classified into the class corresponding to the combination of the second plurality of plant diseases; transmitting classification data related to the plurality of classifications into a class corresponding to one of the first plurality of plant diseases or the healthy condition and the one or more classifications to the user device.

In some embodiments, the system is programmed to build from multiple training sets multiple digital models, each for recognizing plant diseases having symptoms of similar sizes. Each digital model can be implemented with a deep learning architecture that classifies an image into one of several classes. For each training set, the system is thus programmed to collect images showing symptoms of one or more plant diseases having similar sizes. These images are then assigned to multiple disease classes. For a first one of the training sets used to build the first digital model, the system is programmed to also include images that correspond to a healthy condition and images of symptoms having other sizes. These images are then assigned to a no-disease class and a catch-all class. Given a new image from a user device, the system is programmed to then first apply the first digital model. For the portions of the new image that are classified into the catch-all class, the system is programmed to then apply another one of the digital models. The system is programmed to finally transmit classification data to the user device indicating how each portion of the new image is classified into a class corresponding to a plant disease or no plant disease.

Growing community of inventors

Pacifica, CA, United States of America

Yichuan Gui