Deere & Company

Blue River Technology Inc.

Light Labs Inc.

Pablo A Anigstein

Rajiv Laroia

Atul Maharshi

A wiper is controlled to sweep a surface area, e.g., a portion of a windshield, in front of a camera, e.g., a camera mounted inside a vehicle. An image captured from the camera after the wiper completes, e.g., immediately completes, the sweep of the surface area in front of the camera is used in generating a depth map. In some embodiments a first wiper is controlled to clear a surface area in front of a first camera while a second wiper is controlled to clear a surface area in front of second camera at the same time, and the first and second cameras are synchronized to initiate image capture at the same time, capturing images through recently cleared area, and the captured images are used to generate a depth map. A vehicle control operation, e.g., a direction, braking or speed control operation is performed based on the depth map.

Methods and apparatus for capturing and using images in a system including wipers

Methods and apparatus for processing images captured by cameras for use in stereo depth determinations are described and/or for using depth information generated by processing such images is described. Images are captured using a reference camera and at least one additional camera. Filtering is implemented as part of a patch matching process to reduce the risk of erroneous matches, e.g., due to image blur in one image but not another. The filtering may be, and sometimes is, implemented on a patch basis. A candidate patch is generated by filtering a portion of an image captured by a camera, e.g., a second camera by performing a sharpening or blurring operation to a portion of the image to generate a candidate patch. The amount of blurring or sharpening that is applied to generate the candidate patch depends, in some embodiments, on the relative difference between the candidate patch and the reference patch. Thus in some embodiments the amount of sharpening and blurring is dependent on both the content of the reference patch as well as the portion of the second image used to generate the candidate patch.

Methods and apparatus for using filtering to improve image patch matching and/or for using depth information generated from stereo images

Methods and apparatus for using a controllable filter, e.g., an liquid crystal panel, in front of a camera are described. The filter is controlled based on the luminosity of object in a scene being captured by the camera to reduce or eliminate luminosity related image defects such as flaring, blooming or ghosting. Multiple cameras and filters can be used to capture multiple images as part of a depth determination processes where pixel values captured by cameras at different locations are matched to determine the depth, e.g., distance from the camera or camera system to object in the environment. Pixel values are normalized in some embodiments based on the amount of filtering applied to a sensor region and sensor exposure time. The filtering allows for regional sensor exposure control at an individual camera even though the overall exposure time of the pixel sensors may be and often will be the same.

Growing community of inventors

Palo Alto, CA, United States of America

Pablo A Anigstein