Blue River Technology Inc.

Deere + Company

Christopher Grant Padwick

James Patrick Ostrowski

Chia-Chun Fu

Olgert Denas

Benjamin Kahn Cline

William Louis Patzoldt

Sonali Subhash Tanna

Lee Kamp Redden

Rajesh Radhakrishnan

Kent M Anderson

Andrei Polzounov

A method for calibrating performance characteristics of a farming machine using a performance report is described. The farming machine accesses images of plants in a field captured during the calibration pass. The images are input into a performance model to generate a performance report by identifying plants in the images using a plurality of identification sensitivities and determining expected performance characteristics of the farming machine for each of the identification sensitivities. As such, the performance report includes expected performance characteristics for each identification sensitives. The farming machine accesses a target performance characteristic (e.g., from an operator) for the farming machine corresponding identification sensitivity. Images are input into a plant identification model during a treatment pass which identify a plant in the field using the identification sensitivity corresponding to the target performance characteristic. The farming machine treats the plant in the field using a treatment array of the farming machine.

Estimating performance and selecting operating parameters for a farming machine using a calibration pass

A farming machine moves through a field and includes an image sensor that captures an image of a plant in the field. A control system accesses the captured image and applies the image to a machine learned plant identification model. The plant identification model identifies pixels representing the plant and categorizes the plant into a plant group (e.g., plant species). The identified pixels are labeled as the plant group and a location of the pixels is determined. The control system actuates a treatment mechanism based on the identified plant group and location. Additionally, the images from the image sensor and the plant identification model may be used to generate a plant identification map. The plant identification map is a map of the field that indicates the locations of the plant groups identified by the plant identification model.

Plant group identification

A farming machine includes one or more image sensors for capturing an image as the farming machine moves through the field. A control system accesses an image captured by the one or more sensors and identifies a distance value associated with each pixel of the image. The distance value corresponds to a distance between a point and an object that the pixel represents. The control system classifies pixels in the image as crop, plant, ground, etc. based on depth information in in the pixels. The control system generates a labelled point cloud using the labels and depth information, and identifies features about the crops, plants, ground, etc. in the point cloud. The control system generates treatment actions based on any of the depth information, visual information, point cloud, and feature values. The control system actuates a treatment mechanism based on the classified pixels.

Identifying and avoiding obstructions using depth information in a single image

A farming machine includes one or more image sensors for capturing an image as the farming machine moves through the field. A control system accesses the image(s) and creates a labelled three-dimensional point cloud representing the field. The control system identifies and treats plants based on the labelled point cloud. To do so, the control system applies pre-processing functions to the labelled point cloud to determine characteristics of the field and/or modify labels in the point cloud. Point clusters in the point cloud are identified as plants, crops, weeds, ground, etc., using the determined characteristics and modified labels. The control system derives feature values for the plants based on the determined characteristics and labels. If the feature value indicates that the plant should be treated, the farming machine actuates a treatment mechanism to treat the plant.

Extracting feature values from point clouds to generate plant treatments

A farming machine including a number of treatment mechanisms treats plants as the farming machine moves through the field. The control system of the farming machine executes a plant identification model configured to identify plants in the field for treatment. The plant identification model is also configured to identify plants in non-ideal operating conditions. For example, the control system can identify and treat plants in non-ideal operating conditions where airborne particulates are present in an accessed image. The plant identification model is also configured to determine a particulate level in an accessed image and transmit a notification of the particulate level to an operator of the farming system. The control system generates a treatment map identifying which treatment mechanisms to actuate to treat the plants in the field. The farming machine treats the plants in the field according to the treatment map.

Plant identification in the presence of airborne particulates

A plant treatment platform uses a plant detection model to detect plants as the plant treatment platform travels through a field. The plant treatment platform receives image data from a camera that captures images of plants (e.g., crops or weeds) growing in the field. The plant treatment platform applies pre-processing functions to the image data to prepare the image data for processing by the plant detection model. For example, the plant treatment platform may reformat the image data, adjust the resolution or aspect ratio, or crop the image data. The plant treatment platform applies the plant detection model to the pre-processed image data to generate bounding boxes for the plants. The plant treatment platform then can apply treatment to the plants based on the output of the machine-learned model.

Automated plant detection using image data

A farming machine includes one or more image sensors for capturing an image as the farming machine moves through the field. A control system accesses an image captured by the one or more sensors and identifies a distance value associated with each pixel of the image. The distance value corresponds to a distance between a point and an object that the pixel represents. The control system classifies pixels in the image as crop, plant, ground, etc. based on the visual information in the pixels. The control system generates a labelled point cloud using the labels and depth information, and identifies features about the crops, plants, ground, etc. in the point cloud. The control system generates treatment actions based on any of the depth information, visual information, point cloud, and feature values. The control system actuates a treatment mechanism based on the classified pixels.

Growing community of inventors

Menlo Park, CA, United States of America

Christopher Grant Padwick