Toyota Jidosha Kabushiki Kaisha

Denso Corporation

Denso Corpora Tion

Ken Tanabe

Naohide Uchida

Hirotake Ishigami

Masaki Kuwahara

Hiroaki Ito

Noriaki Shirai

Masakazu Nishijima

Fumio Sugaya

An apparatus for detecting a lane boundary includes one or more processors configured to: input an image representing a region around a vehicle into a classifier to identify the types of objects represented in respective pixels of the image, and detect a boundary of the travel lane by determining, for each of pixel lines in a direction crossing the travel lane in the image, whether the position corresponding to a pixel group including a predetermined number of contiguous pixels is inside the travel lane in order along a scanning direction from one end to the other end of the pixel line, depending on the order of the types of objects represented in the pixel group and the result of determination whether the position corresponding to the immediately preceding pixel group with respect to the scanning direction is inside the travel lane.

Apparatus, method, and computer program for detecting lane boundary

A road surface detecting apparatus comprises a camera sensorfor taking images of a region in front of a vehicle, and an electronic control unit (ECU) configured to: calculate, based on a taken image, parallax information including a parallax of each pixel composing the taken image; extract a pixel corresponding to a road surface from the taken image; acquire, based on information of the extracted pixel, information-indicating-a-road-surface; calculate, based on the information-indicating-a-road-surface, a road surface gradient formula by approximating a gradient of the road surface by a quadratic function; determine whether or not an absolute value of a coefficient of a quadratic term of this formula is greater than a coefficient threshold; and invalidate the information-indicating-a-road-surface when the absolute value is determined to be greater than the threshold.

Road surface detecting apparatus

A target object estimating apparatus comprises parallax information calculating means for calculating parallax information including a parallax between corresponding pixels of taken images taken at a same computation timing, road surface region detecting means for detecting a road surface region in the taken image based on the parallax information, road surface region determining means for determining whether or not each pixel in the taken image corresponds to the road surface region, transition information calculating means for calculating transition information including a change amount of a position of each pixel, using temporally sequential taken images, and estimated value calculating means for estimating a position and a speed of a target object by calculating, based on the parallax/transition information, estimated values of the position and the speed of each pixel. The estimated value calculating means does not calculate the estimated values for a pixel determined to correspond to the road surface region.

Target object estimating apparatus

In a monitoring apparatus, an optical flow calculator calculates an optical flow for each of selected pixel regions included in at least one pixel region group of an image. The optical flow for each of the selected pixel regions includes information about a direction and amount of movement of a corresponding part of the at least one target object. An adjuster calculates the sum of areas of all the pixel regions included in the at least one pixel region group of the image, and adjusts a selected number of the optical flows to be matched with the at least one pixel region group as a function of the calculated sum of the areas of all the pixel regions included in the at least one pixel region group.

Method and apparatus for monitoring region around vehicle

An apparatus comprises three-dimensional object detecting means for detecting a three-dimensional object in a taken image, temporarily determining means for calculating, based on parallax information, a lower end height from a road surface to a lower end of the object, for temporarily determining that the object is a ground-contacting object when the lower end height is less than or equal to a threshold, and for temporarily determining that the object is a floating object when the lower end height exceeds the threshold, and finally determining means for finally determining whether the object is a ground-contacting object or a floating object. The finally determining means finally determines that the object is a ground-contacting object at the current computation timing when the object is determined to be a ground-contacting object in at least one of the temporary determination at the current computation timing and the final determination at the previous computation timing.

Three-dimensional object ground-contact determining apparatus

In a monitoring apparatus, a disparity calculator obtains, for each point of a target object, a pair of matched pixel regions in respective base image and reference image corresponding to the point of the target object. The disparity calculator calculates a disparity of each of the matched pixel regions of the base image relative to the corresponding matched pixel region of the reference image. A distance calculator corrects the calculated disparity of each of the matched pixel regions of the base image in accordance with a tolerable disparity range for the disparity to thereby increase the calculated disparity of the corresponding one of the matched pixel regions of the base image. The distance calculator calculates the depth distance of each point of the target object relative to the vehicle as a function of the corrected disparity of the corresponding one of the matched pixel regions.

A parallax calculating apparatus comprises first parallax calculating means for calculating a first parallax on a basis of a reference image for all pixels in the reference image using SGM method, second parallax calculating means for calculating a second parallax on a basis of the reference image for at least a part of pixels among pixels in the reference image using BM method, and final parallax calculating means for calculating a final parallax of each of pixels in the reference image based on the first and second parallaxes. The final parallax calculating means calculates the first parallax as the final parallax for a pixel for which only the first parallax has been calculated and calculates a parallax where a decimal part of the first parallax is replaced with that of the second parallax as the final parallax for a pixel for which the first and second parallaxes have been calculated.

Parallax calculating apparatus

In an object detection apparatus, a range image generator, based on distance information indicative of distances from a given measurement point to objects in real space, generates a range image indicative of a distribution of distance information of objects located around the measurement point. A subgroup generator horizontally divides the range image into a number of column regions of prescribed width, and for each column region, generates one or more subgroups that extend continuously in a vertical direction of the range image and fall within a given range of distance information. A continuity determiner determines, for each of the subgroups, whether or not there is distance continuity between the subgroup and its horizontally adjacent subgroup in the range image. A merger merges together horizontally continuous-in-distance subgroups. An object detector detects an object in each of regions of the range image corresponding to the respective merged groups.

Growing community of inventors

Kariya, Japan

Ken Tanabe