Denso Corporation

Toyota Jidosha Kabushiki Kaisha

Aisin Corporation

Aisin Seiki Kabushiki Kaisha

Takuhiro Omi

Yutaka Munaoka

Takeshi Enya

Hiroto Banno

Shinichi Kojima

Takashi Naito

Isahiko Tanaka

Minori Yamataka

Satoru Nakanishi

Fumiya Nagai

Udara Eshan Manawadu

Hiroshi Morimoto

Kenta Yamada

Taito Watanabe

Takashi Hiramaki

Jun Adachi

Yoshinao Takemae

Yoshiki Ninomiya

Junya Kasugai

Akira Kadoya

Mitsuru Ambai

Takahiro Yamamoto

Yosuke Sakai

Hiroyuki Ishizaka

Takumi Yoda

Ryuta Terashima

Taishi Tsuda

A notification device detecting a predetermined action of a driver of a vehicle in which travel is controlled by an autonomous driving system from a driver image including a face region representing a face of the driver and outputting a confidence rate indicating a certainty in the detection, specifying a message for inhibiting a control ending action which possibly follows the detected action and corresponds to an ending condition of control by the autonomous driving system, and notifying the driver of the specified message through an output device when an effectiveness level is higher than a predetermined notification threshold, the effectiveness level calculated by multiplying the confidence rate by a first probability of the control ending action being inhibited when notifying the driver of the specified message or by a second probability of the control ending action being performed when not notifying the driver of the specified message.

Notification device and notification method

With reference to a message table associating a plurality of messages to be notified to a driver of a vehicle with a first condition, a second condition, last notification time of the message, and renotification requirement, a notification device selects messages associated with an identified first condition corresponding to a situation of surroundings of a vehicle or a state of a driver, selects, from among the messages associated with the identified first condition, messages associated with an identified second condition corresponding to a state of the driver, specifies, from among the messages associated with the identified second condition, a message without a record of last notification time or a message with a record of last notification time and with a renotification requirement requiring a renotification, and notifies the specified message to the driver through an output device.

A data transmitter to be mounted on a vehicle detects the driver's state from output data of a camera mounted on the vehicle. The data transmitter determines whether the driver's state is suitable for continuing the control by the level of autonomous driving; transmits, when it is determined that the state is suitable for continuing the control, the face image to a terminal communicably connected via a communication network, together with a first setting for displaying the face image on the terminal in first mode; and transmits, when it is determined that the state is unsuitable for continuing the control, the face image to the terminal, together with a second setting for displaying the face image on the terminal in second mode that draws more attention of a user of the terminal than the first mode.

Data transmitter and method for data transmission

A data transmitter is to be mounted on an autonomous driving vehicle. The data transmitter determines whether a confidence score indicating the degree of reliability of detection of the object from the area image is greater than a predetermined confidence score threshold; transmits, when the confidence score regarding the area image is greater than the confidence score threshold, the area image or a face image representing the face of a driver to a terminal, together with a first setting for displaying the area image or the face image on the terminal in first mode; and transmits, when the confidence score is less than the confidence score threshold, the area image to the terminal, together with a second setting for displaying the area image on the terminal in second mode that draws more attention of a user of the terminal than the first mode.

Apparatus detecting driving incapability state of a driver includes: a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver's seat captured by an imaging device mounted in a vehicle; and an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle.

Apparatus detecting driving incapability state of driver

A state detection device includes a camera configured to capture an image of an imaging area where a driver is present, a laser configured to emit light toward the imaging area, and an optical member configured to emit the light of the laser with spreading to a predetermined irradiation area.

State detection device

A feature point position estimation device is provided. The feature point position estimation device includes a subject detection section for detecting a subject region from a subject image, a feature point positioning section for positioning a feature point at a preliminarily prepared initial feature point position with respect to the subject region, a feature amount acquisition unit for acquiring a feature amount of the feature points arranged, a regression calculation unit for calculating a deviation amount of a position of a true feature point with respect to the position of the feature point by performing a regression calculation on the feature amount, and a repositioning unit for repositioning the feature points based on the deviation amount. The regression calculation unit calculates the deviation amount by converting the feature amount in a matrix-resolved regression matrix.

Feature point estimation device, feature point position estimation method, and computer-readable medium

An apparatus detecting driving incapability state of a driver includes: an inclination detection portion that detects inclination of a head of a driver with respect to a trunk of the driver lower than a neck, based on an image of a driver seat captured by an imaging device mounted on a vehicle; and a posture collapse detection portion that detects the driver is incapable of driving when the inclination of the head detected by the inclination detection portion is greater than a relative inclination threshold during travel of the vehicle.

An apparatus detecting driving incapability state of a driver includes: a head detection portion that detects a head of the driver based on an image of a driver's seat captured by an imaging device mounted on a vehicle; and a shake detection portion that detects the driver is incapable of driving when an amplitude of a shake of the head detected by the head detection portion is smaller than a first amplitude or larger than a second amplitude, which is larger than the first amplitude, before a shake determination time elapses after external force has been applied to the vehicle during travel of the vehicle.

A driver state determination apparatus includes a far-infrared camera and a state determination section. The far-infrared camera takes facial images of a driver of a vehicle; the facial images are far-infrared images indicating a temperature distribution on a facial surface of the driver. The state determination section determines an abnormal state of the driver based on the far-infrared images sequentially taken by the far-infrared camera during a predetermined period.

Driver state determination apparatus

An image pickup device includes a first emission unit that emits a near infrared light toward a face of a driver from a front lower side of the driver, and a second emission unit that emits a near infrared light from an upper side of the driver. When a sunvisor is present at a storage position in which sunlight is not shielded, the second emission unit is disposed at a position to be covered with the sunvisor. A portion where the sunvisor present at a storage position covers the second emission unit is made of a material that shields a visible light contained in the sunlight and transmits the near infrared light.

Growing community of inventors

Anjo, Japan

Takuhiro Omi