Denso Corporation

Nippon Soken, Inc.

Denso Corpora Tion

Toyota Motor Engineering & Manufacturing North America, Inc.

Denso International America, Inc.

Hirohiko Yanagawa

Mitsuyasu Matsuura

Yu Maeda

Taketo Harada

Masayuki Imanishi

Muneaki Matsumoto

Nobuyuki Yokota

Hideki Otsuka

Akihiro Sunasaka

Shingo Imura

Yoshinori Ozaki

Shogo Omiya

Yoshihisa Sato

Justin McBride

Hiroaki Takeda

Michael Wiegand

Masakazu Takeichi

Christian Arthur Trager

Thomas J Keeling

Toshihiro Wakamatsu

Masato Okuda

Christopher M Kurpinski

Tanemichi Chiba

Tetsuya Oki

Bingchen Wang

Yohei Suzuki

Hideki Shirai

Kohji Katoh

Hideki Ootsuka

Kenji Kohara

Tetsuri Ishikawa

Woocheol Shin

Satoshi Hoshi

Lisa Marie Brown

Jeffrey Edward Angeliu

In an image generation apparatus, an image acquisition unit is configured to acquire, from at least one camera operable to capture an image of surroundings of a vehicle, a captured image. A bird's-eye view image generation unit is configured to generate a bird's-eye view image from the captured image. A three-dimensional object recognition unit is configured to recognize a three-dimensional object in the captured image. A superimposition-image acquisition unit is configured to acquire a superimposition image that represents the three-dimensional object recognized by the three-dimensional object recognition unit, by performing a process depending on a type of the three-dimensional object recognized by the three-dimensional object recognition unit. A superimposition unit is configured to superimpose, onto the bird's-eye view image, the superimposition image acquired by the superimposition-image acquisition unit, at a position where the three-dimensional object is present in the bird's-eye view image.

Image generation apparatus and image display system for superimposition of three-dimensional objects into bird's view images

An image processing unit identifies the shape of an obstacle that is identified from an area that appears in a peripheral image based on an image captured by a camera. The shape of the obstacle includes at least a tilt of a section of the obstacle in a road-surface direction. The section of the obstacle faces a vehicle. The image processing unit generates a superimposed image in which a mark image that is generated as a pattern that indicates the identified obstacle is superimposed onto a position that corresponds to the obstacle in the peripheral image. At this time, the image processing unit variably changes properties of the mark image based on the tilt of the obstacle identified by an obstacle identifying unit. The image processing unit then displays the generated superimposed image on display apparatus.

Display control apparatus

In an object detection device to be installed to a vehicle and detect an object outside the vehicle, a position calculator sets multiple candidate points representing a candidate position of the object, based on positions of feature points extracted from a first image captured at a first time. The multiple candidate points are set to be denser within a detection range set based on a distance to the object detected by the ultrasonic sensor than outside the detection range. The position calculator estimates positions of the multiple candidate points at a second time which is after the first time, based on the positions of the multiple candidate points and movement information of the vehicle, and calculates the position of the object by comparing the estimated positions of the multiple candidate points at the second time and the positions of the feature points extracted from a second image captured at the second time.

Object detection device

An embodiment of the present disclosure relates to an image generation device including an image acquisition unit, a position recognition unit, a boundary line setting unit, and an image compositing unit. The image acquisition unit is mounted to a vehicle, and configured to acquire a plurality of captured images in which the periphery of the vehicle is imaged by a plurality of imaging units having an overlap region where imaging regions thereof partially overlap with each other. The position recognition unit is configured to recognize positions of specific obstacles which are one or more obstacles positioned in the overlap region. The boundary line setting unit is configured to set the boundary line so that each of the specific obstacles is contained in the image captured by the imaging unit which is closest in distance to the specific obstacle, among the plurality of imaging units. The image compositing unit is configured to generate a composite image in which the plurality of captured images are combined, using the boundary line as a boundary when combining the plurality of captured images.

Image generation device and image generation method for generating a composite image

An object detection device acquires a plurality of images captured by a camera mounted in a moving body and acquires movement information of the camera. The object detection device extracts an edge from a first image among the acquired images. The object detection device calculates a plurality of candidate points corresponding to the edge in a second image, based on the movement information and calculates candidate points corresponding to a plurality of heights as height candidates of the edge. The object detection device calculates a correlation index value between the edge and each of the plurality of candidate points and detects the candidate point with the largest correlation as a correspondence point of the edge. The object detection device detects an object at a position of the edge when the correlation index value of the detected correspondence point is equal to or smaller than a predetermined threshold.

Object detection device, object detection method, and computer-readable recording medium

An aspect of the present disclosure is an image creation device installed in a vehicle. The image creation device includes an image capture section and a bird's-eye view image creation section. The image capture section acquires a captured image within a peripheral range around the vehicle. The bird's-eye view image creation section creates a bird's-eye view image. The bird's-eye view image creation section includes a contour extraction section, a region discrimination section, a first creation section, a second creation section, and an image combining section. The contour extraction section extracts the contour shape of an object in the captured image. The region discrimination section judges whether the contour region is a three-dimensional object region or a road surface region. The first creation section creates a stereoscopic image, and the second creation section creates a planar view image. The image combining section combines the stereoscopic image and the planar view image.

Image creation device and image creation method

An object detection apparatus is provided with a distance measurement sensor that measures a distance to an object which exists in a surrounding area of a vehicle, by transmitting scanning waves to the surrounding of the vehicle and receiving reflection waves of the scanning waves, and an image acquiring section that is adopted to the vehicle, and is provided with an on-vehicle camera that captures images in the surrounding of the vehicle, the imaging acquiring section acquiring an image that is captured by the camera. The apparatus includes a determination section that determines whether, a predetermined object that is difficult to detect by the reflection waves of the distance measurement sensor is included in the object image, and a sensitivity control section that increases a sensitivity of the object detection by the distance measurement sensor and a vehicle control that is executed relative to the predetermined object as a target object.

Object detection apparatus

An image creation device is provided with an image acquisition unit acquiring multiple captured images of a peripheral area, a detection unit detecting a three-dimensional object present in the peripheral area, a first conversion unit converting the multiple captured images into multiple individual overhead images to create a first conversion image by means of an overall overhead image, a second conversion unit creating a second conversion image in which an image captured from a virtual camera is converted in accordance with the conversion rule, the virtual camera being virtually arranged at a virtual position set on the vehicle such that a virtual optical axis direction faces the direction of the three-dimensional object, and a synthesis unit synthesizes the second conversion image on the first conversion image to create a synthesis image.

Image creation device

An obstacle detection apparatus includes a distance measuring sensor, an imaging section, and a control section. Based on a reception result of reception waves obtained by the distance measuring sensor, the control section acquires an estimated reflection position in an illuminated region already irradiated with search waves. Based on the estimated reflection position, the control section recognizes an outer shape of an obstacle. Based on an imaging result obtained by the imaging section, the control section performs image recognition of the obstacle. Based on a recognition result of the outer shape of the obstacle and a result of the image recognition, the control section acquires a relative position, with respect to a vehicle, of a portion of the obstacle in an image captured by the imaging section included in a non-irradiated region ahead of the illuminated region in a vehicle traveling direction.

Obstacle detection apparatus

A parking assisting apparatus includes an imaging unit acquiring image information corresponding to an image of surroundings of a vehicle, an image processing section recognizing a feature shape in the image by processing the image information, an obstacle detecting section acquiring positional-relationship information corresponding to a positional relationship between the vehicle and an obstacle present around a parking space, and a manner-of-parking selecting section selecting a manner of parking the vehicle in the parking space from manner candidates including perpendicular parking and parallel parking based on the feature shape and the positional-relationship information. The manner-of-parking selecting section selects the manner of parking from the manner candidates by integrating a likelihood of each of the manner candidates based on the positional-relationship information with a likelihood of the manner candidate based on a recognition result to calculate final likelihoods of the respective manner candidates, and by comparing the calculated final likelihoods.

Parking assisting apparatus and control unit

A perimeter monitoring device is applied to a vehicle comprising a distance measuring sensor for transmitting a probing wave and receiving a reflected wave of the probing wave and an imaging device for capturing an image of the surroundings of the vehicle. The perimeter monitoring device comprises: an information acquisition unit for acquiring distance information, directional information, and object width information of an object existing in the vicinity of the vehicle as detection information of the object provided by the distance measuring sensor; an area setting unit for setting an image processing area on which image processing is performed in the image captured by the imaging device based on the distance information, the directional information, and the object width information acquired by the information acquisition unit; and an object recognition unit for performing the image processing on the image processing area set by the area setting unit to recognize the object.

Perimeter monitoring device and perimeter monitoring method

A driving assistance device converts an image captured by an in-vehicle camera configured to image the periphery of a vehicle into an image viewed from a virtual viewpoint. The driving assistance device combines, as a higher-level layer, a vehicle image indicating the position and shape of the vehicle with a converted target image. The driving assistance device adjusts the opacity of the vehicle image such that the target image as a lower-level layer is visible at a superimposed portion of the vehicle image and the target image. At this point, the opacity of the vehicle image is variably set according to at least one of an own vehicle surrounding condition or a vehicle running condition. The driving assistance device outputs, as a driving assistance image, the target image combined with the adjusted vehicle image.

Driving assistance device and driving assistance method

An image processing unit repeatedly acquires a captured bird's-eye image which is obtained by bird's-eye conversion of a captured image of the surroundings of a vehicle. An image processing unit acquires a history image that is a bird's-eye image corresponding to a predetermined area in front in the traveling direction at each timing determined according to a predetermined condition. The image processing unit acquires a history image at every predetermined first cycle if an unstable condition related to a behavior of the vehicle is not satisfied. If an unstable condition is satisfied, the history image is acquired at a later timing than the first cycle. The image processing unit creates a bird's-eye image for display by extracting an area corresponding to a non-imaging area of the latest captured bird's-eye image from among the accumulated history images, and combining the extracted area with the non-imaging area.

Display control device

An image recognition device includes an image acquisition unit, a moving object detection unit, and a pedestrian detection unit. The image acquisition unit acquires consecutive captured images of a surrounding of a vehicle from a camera mounted to the vehicle. The moving object detection unit calculates a moving amount based on consecutive captured images in time series acquired by the image acquisition unit to detect a moving object from the captured images. The pedestrian detection unit detects a pedestrian using an identifier for identifying a pedestrian from the captured images acquired by the image acquisition unit. The pedestrian detection unit relaxes a detection criterion for detecting a pedestrian using the identifier in a region of a captured image where the moving object is detected.

Growing community of inventors

Kariya, Japan

Hirohiko Yanagawa