Clarion Co

Faurecia Clarion Electronics Co., Ltd.

Hitachi Astemo Ltd.

Morihiko Sakano

Shinya Tagawa

Keiji Sato

Masahiro Kiyohara

Takahiro Sakai

Manabu Kawabe

Nobuyuki Matsuyama

Takehito Ogata

Daisuke Fukuda

Junya Murayama

Yoshitaka Uchida

Toshiyuki Aoki

Hidehiro Toyoda

Hideyuki Kume

Katsumi Iwano

Tsukasa Saito

Yoshihiko Araya

Tsukasa Okada

Yusuke Takada

Provided are a self-map generation device and a self-position estimation device with which it is possible to achieve high-accuracy self-position estimation even when an observation error due to a sensor is large by estimating an error amount of a landmark serving as an observation point and improving the quality of a self-generated point group map. This self-map generation device generates a point group map from point group data of external information obtained by a vehicle-mounted sensor mounted in a vehicle, and comprises: a landmark detection unit that detects a landmark from the point group map; a landmark information accumulation unit that accumulates observation position information of the detected landmark; a landmark position correction unit that corrects the position of the landmark on the basis of point group coordinates extracted from an error distribution detected when the observation position information of the landmark has been frequency-distributed; and a self-map generation unit that saves, as a self-generated map, a corrected map obtained by correcting the position of the landmark and obtained from the landmark position correction unit.

Self-map generation device and self-position estimation device

An external recognition device that detects and tracks a moving object includes an object position detection unit that detects a position of the moving object as an observation value, based on an image; a region determination unit that determines a region to which the moving object belongs in the image, based on the observation value; an observation error setting unit that calculates an error to an observation value, based on a determination result; a state prediction unit that predicts a state of the moving object at a current time, based on the observation value up to a previous time that is a time earlier than the current time and the error; an association unit that associates the state of the moving object at the current time with the observation value; and a state update unit that updates the state of the moving object, based on a result of the association.

External recognition device

In an onboard processing device, a parking path when a vehicle, which is a target vehicle, enters a parking place and a parking map including the parking place are obtained by an information obtaining unit, a peripheral environment of the vehicle is detected by a periphery detection unit, a vehicle position on the parking map is estimated by a vehicle position estimation unit, and a drive-out path when the vehicle is driven out from the parking place is set based on the estimated vehicle position, the parking path, and the detected peripheral environment by a path setting unit.

Onboard processing device and control method for onboard processing device

A position estimation apparatus includes: an image information calculation unit that extracts each of image feature points from a plurality of images which are sequentially captured and associates the image feature points with each other between the plurality of images; a travel amount calculation unit that estimates the position of the mobile object; a three-dimensional image feature point calculation unit that estimates a three-dimensional position of the image feature point in a real space on the basis of a result of associating the image feature points with each other and the position of the mobile object; a position correction unit that corrects the three-dimensional position and the position of the mobile object so as to reduce a position error between a position of the three-dimensional position, when the three-dimensional position is reprojected onto any one of the plurality of images, in the relevant image and the image feature point; a route regeneration judgment unit that judges whether or not to regenerate the route on the basis of a result of comparison between the corrected position of the mobile object and the route.

Position estimation apparatus

An overhead-view image generation device includes: a moving amount calculation unit that calculates a moving distance of a vehicle; a linear overhead-view image generation unit that generates an overhead-view image obtained by conversion of a viewpoint of a captured image of a camera into an overhead viewpoint, and generates a linear overhead-view image obtained by conversion of a shape of the generated overhead-view image into a linear shape; a distance-based turning angle generation unit that calculates, using a turning amount of the vehicle indicated by sensor data of a steering angle sensor and the moving distance calculated by the moving amount calculation unit, distance-based turning angle information indicating a turning angle of the vehicle based on the moving distance; and an overhead-view image reconstruction unit that reconstructs the overhead-view image using the linear overhead-view image and the distance-based turning angle information.

Overhead-view image generation device, overhead-view image generation system, and automatic parking device

A travel amount estimation apparatus includes a vehicle travel amount calculation unit, a sensor travel amount calculation unit, an error cause determination unit, and a vehicle travel amount correction unit. The vehicle travel amount calculation unit acquires vehicle information and calculates a vehicle travel amount based on the vehicle information. The sensor travel amount calculation unit acquires sensor information from an external sensor and calculates a sensor travel amount based on the sensor information. The error cause determination unit determines an error cause of the vehicle travel amount. The vehicle travel amount correction unit corrects the vehicle travel amount by using the sensor travel amount in accordance with the error cause and estimates a travel amount of the vehicle on which it is mounted.

Travel amount estimation apparatus

Calibration with high accuracy can be realized even when performing the calibration while running on the actual road. Specifically, the calibration apparatus is mounted in a vehicle and includes: an image acquisition unit configured to acquire captured images obtained by a camera, which is mounted in the vehicle, capturing images of surroundings of the vehicle; a feature point extraction unit configured to extract a plurality of feature points from the captured images; a tracking unit configured to track the same feature point from a plurality of the captured images captured at different times with respect to each of the plurality of feature points, which are extracted by the feature point extraction unit, and record the tracked feature point as a feature point trajectory; a lane recognition unit configured to recognize an own vehicle's lane which is a driving lane on which the vehicle is running, from the captured images; a sorting unit configured to sort out the feature point trajectory, which is in the same plane as a plane included in the own vehicle's lane recognized by the lane recognition unit, among feature point trajectories tracked and recorded by the tracking unit; and an external parameter estimation unit configured to estimate external parameters for the camera by using the feature point trajectory sorted out by the sorting unit.

Calibration apparatus and calibration method

High precision calibration of external parameters is possible even when the surrounding road surface is configured from a plurality of flat surfaces. Specifically, provided is a calibration device comprising a camera to be mounted on a vehicle traveling on a road surface; a characteristic point extraction unit which extracts characteristic points from a captured image obtained by being captured with the camera; a tracking unit which tracks the characteristic points extracted with the characteristic point extraction unit; a storage unit which stores a trajectory of the characteristic points obtained by tracking the characteristic points; a road surface estimation unit which estimates a flat surface on which the vehicle is traveling by using the trajectory of the characteristic points; a calculation unit which calculates a calibration trajectory, which is a trajectory of the characteristic points, for use in calibration based on the estimated flat surface; and an external parameter estimation unit which executes calibration of an external parameter of the camera by using the calibration trajectory.

Calibration device and calibration method

An information processing apparatus includes: a point group data acquisition unit configured to acquire, based on information from a sensor configured to detect an object existing in surroundings of a vehicle, point group data related to a plurality of points representing the object; a movement amount estimation unit configured to estimate a movement amount of the vehicle; a storage unit configured to store, as a point group map recorded in association with position information including a latitude and a longitude, relative positions of the plurality of points relative to a first reference position that is a place on a travel path of the vehicle; and a position estimation unit configured to estimate a position of the vehicle based on the point group map, the point group data, and the movement amount.

Information processing apparatus

An in-vehicle processing apparatus is capable of performing position estimation resistant to disturbance. The in-vehicle processing apparatus includes: a storage unit that stores point cloud data including a plurality of coordinates of a point representing a portion of an object in a first coordinate system; a sensor input unit that acquires an output of a sensor that acquires information regarding vicinity of a vehicle; a movement information acquisition unit that acquires information related to movement of the vehicle; a local periphery information creation unit that generates local periphery information including a position of the vehicle in a second coordinate system and a plurality of coordinates of a point representing a portion of an object in the second coordinate system on the basis of information acquired by the sensor input unit and the movement information acquisition unit; and a position estimation unit that estimates a relationship between the first coordinate system and the second coordinate system on the basis of the point cloud data and the local periphery information and then estimates the position of the vehicle in the first coordinate system.

In-vehicle processing apparatus

There are provided a calibration apparatus and method capable of obtaining a high-precision calibration result by taking out only feature points on a road surface from images captured by an in-vehicle camera which is a calibration target. A road surface range is estimated by using feature points appearing in an image(s) captured by a camera (a front cameraor a rear camera) that is not a camera on which the calibration is executed (a side camera); and the calibration is executed by using only feature points existing within the estimated road surface range from among the feature points appearing in an image(s) captured by the camera on which the calibration is executed.

Calibration apparatus and method for in-vehicle camera

The present invention aims at obtaining an in-vehicle processing apparatus for automatically selecting modes. An in-vehicle processing apparatusaccording to the present invention includes a mode switching unitD that makes a transition, based on latitude-longitude positioning information of a vehicle, between: a map storage modeto acquire and store point group data in a storage unit when a vehicleapproaches a preset registered spot and point group data of surroundings of the vehicle is not stored in the storage unit; and a position estimation modeto have a position estimation unitC estimate a position of the vehicle when the vehicle approaches the registered spot and the point group data of surroundings of the vehicle is stored in the storage unit.

A calibration system is mounted in a vehicle and is provided with: an attitude sensor that acquires attitude information regarding a vehicle coordinate system of the vehicle; an image pickup unit that captures an image of the surroundings of the vehicle; an attitude-sensor reliability level calculation unit that calculates an attitude-sensor reliability level that is a reliability level of the attitude sensor; and an attitude use estimation unit that estimates, in the case where the calculated attitude-sensor reliability level is greater than a predetermined threshold, an external parameter of the image pickup unit using the attitude information output by the attitude sensor and a relationship of a coordinate system of the image pickup unit to the vehicle coordinate system.

Calibration system and calibration apparatus

Provided is an on-vehicle processing device that can estimate the position of a vehicle with higher accuracy. A storage unit stores a parking lot point group including a plurality of coordinates of points of a part of an object in a parking lot coordinate system. A sensor input unit acquires peripheral information from a camera. A movement information acquisition unit acquires movement information. A local peripheral information creation unit generates local peripheral information expressing second point group data including a position of the vehicle in a local coordinate system and a plurality of coordinates of points of a part of the object in the local coordinate system on the basis of the peripheral information and the movement information. A position estimation unit estimates a correlation between the parking lot coordinate system and the local coordinate system on the basis of the parking lot point group and the local peripheral information, and estimates the position of the vehicle in the parking lot coordinate system from the position of the vehicle in the local coordinate system and the correlation.

On-vehicle processing device

This camera calibration device is provided with: an image acquisition unit into which a plurality of images captured at different times by a camera mounted to a vehicle are inputted; a feature point extraction unit which extracts features points from each of the images inputted into the image acquisition unit; a feature point tracking unit which tracks the feature points between the plurality of images; a vehicle movement acquisition unit which acquires information related to the movement of the vehicle; a trajectory estimation unit which, on the basis of the information acquired by the vehicle movement acquisition unit, estimates the trajectory of the feature points corresponding to the movement of the vehicle; and an internal parameter estimation unit which estimates internal parameters of the camera on the basis of the trajectory of the feature points tracked by the feature point tracking unit, and the trajectory of the feature points estimated by the trajectory estimation unit.

Growing community of inventors

Tokyo, Japan

Morihiko Sakano