Toyota Jidosha Kabushiki Kaisha

Toyota Research Institute, Inc.

Maiko Hirano

Kentaro Ichikawa

Bunyo Okumura

Kunihito Sato

Hiromitsu Urano

Taisuke Sugaiwa

Yusuke Sawamura

Koji Taguchi

Kunihito Satou

Kohei Otsuka

Narihito Yamazato

Yoshitaka Adachi

A remote assistance management system is in communication with autonomous traveling vehicles for letting an operator provide remote assistance in response to an assistance request from a vehicle. The system predicts an occurrence of an assistance request in future based on operation states of the vehicles, and categorize a cause of an assistance request predicted to occur into a first category cause that lasts for a long time and a second category cause that lasts only for a short time. The system receives an assistance request from the vehicles. In response to acquiring a first assistance request of which the cause is the first category cause from a first vehicle, the system transmits a first command signal for the first vehicle that is decided by an operator to the first vehicle, and applies the first command signal to another vehicle from which the first assistance request is predicted to occur.

Remote assistance management for reducing the load of operators by remote assistance prediction and categorization

According to the remote assistance method of the present disclosure, first, a positional relationship between the vehicle having an autonomous traveling function and an object present around the vehicle at a future time beyond a current time is displayed spatially on a display device, the positional relationship being predicted based on a path plan for autonomous traveling created by the vehicle and information on the object. Next, assistance content input from a remote operator is transmitted to the vehicle. Then, remote assistance corresponding to the assistance content is executed in the vehicle in response to confirmation that the positional relationship between the vehicle and the object displayed on the display device when the assistance content is input is realized after the vehicle receives the assistance content.

Remote assistance method, remote assistance system, and non-transitory computer-readable storage medium

An autonomous driving control device is capable of starting an autonomous driving control without an operation of a driver and reducing a possibility that the driver can not start manual driving. An autonomous driving control is switched to manual driving when a determination section determines that the amount of operation by the driver is equal to or greater than a first threshold, before a predetermined time elapses since the autonomous driving control is automatically started. An autonomous driving control is switched to a manual driving when the determination section determines that the amount of operation by the driver is equal to or greater than a second threshold that is greater than the first threshold, after the predetermined time elapses.

Autonomous driving control device

An autonomous driving device configured to release the autonomous driving control if an override operation is input during the execution of the autonomous driving control which is based on a first travel plan, set a second travel plan different from the first travel plan after the input of the override operation, determine whether or not to restore the autonomous driving control with the autonomous driving control which is based on the second travel plan after the input of the override operation, and maintain the manual driving and prohibit automatic starting of the autonomous driving control until after a predetermined time elapses after the autonomous driving control is released and when the determination is made not to restore the autonomous driving control.

Autonomous driving device

An autonomous driving device includes an autonomous driving release unit that releases the autonomous driving control if an override operation is input during the autonomous driving control which is based on a first travel plan, a travel plan setting unit that sets a second travel plan different from the first travel plan after the input of the override operation, an autonomous driving restore determination unit that determines whether to restore the autonomous driving control with the autonomous driving control which is based on the second travel plan after the input of the override operation, and a vehicle control unit that maintains the manual driving and prohibits automatic starting of the autonomous driving control until after a predetermined time elapses after the autonomous driving control is released and when the autonomous driving restore determination unit determines not to restore the autonomous driving control.

Systems and methods are provided for generating trajectories for a vehicle user interface showing a driver's perspective view. Methods include generating an ego-vehicle predicted trajectory for an ego-vehicle; and generating at least one road agent predicted trajectory for a road agent that is external to the ego-vehicle. After the predicted trajectories are generated, the method continues by determining that at least two predicted trajectories overlap when displayed on the user interface showing a driver's perspective view, when displayed on the user interface showing a driver's perspective view. The method includes modifying the at least one road agent predicted trajectory to remove the overlap. The method then proceeds with updating a display of the user interface to include any modified road agent predicted trajectory. Systems include a trajectory-prediction module to execute the methods.

Autonomous vehicle user interface with predicted trajectories

Systems and methods are provided for generating trajectories for a vehicle user interface showing a driver's perspective view. Methods include generating an ego-vehicle predicted trajectory for an ego-vehicle; and generating at least one road agent predicted trajectory for a road agent that is external to the ego-vehicle. After the predicted trajectories are generated, the method continues by determining that at least one predicted trajectory overlaps either an object or another predicted trajectory, when displayed on the user interface showing a driver's perspective view. The method includes modifying the at least one road agent predicted trajectory to remove the overlap. The method then proceeds with updating a display of the user interface to include any modified road agent predicted trajectory. Systems include a trajectory-prediction module to execute the methods.

Systems and methods are provided for generating trajectories for a vehicle user interface showing a driver's perspective view. Methods include generating an ego-vehicle predicted trajectory for an ego-vehicle; and generating at least one road agent predicted trajectory for a road agent that is external to the ego-vehicle. After the predicted trajectories are generated, the method continues by determining that at least one road agent predicted trajectory both (1) exists behind an object, indicating travel behind the object, and (2) overlaps with the object, when displayed on the user interface showing a driver's perspective view. The method includes modifying the at least one road agent predicted trajectory to remove the overlap. The method then proceeds with updating a display of the user interface to include any modified road agent predicted trajectory. Systems include a trajectory-prediction module to execute the methods.

An automatic driving system includes at least one electronic control unit configured to: generate a traveling plan so as to moderate a change in behavior of a vehicle at a time when an automatic driving control of the vehicle is started by an automatic engagement compared to a change in the behavior of the vehicle at a time when the automatic driving control is started by a triggered engagement, the automatic engagement being an engagement in which the automatic driving control is automatically started when an automatic engagement condition is satisfied, the triggered engagement being an engagement in which the automatic driving control is started when an automatic driving start condition is satisfied and an automatic driving start trigger is input by an occupant; and execute the automatic driving control by controlling the behavior of the vehicle based on the traveling plan, using an actuator equipped in the vehicle.

Automatic driving system

An automatic driving system includes an electronic control unit. The electronic control unit is configured: to create a first travel plan of a vehicle based on a position of the vehicle, an environment surrounding the vehicle, and a state of the vehicle; to calculate a first reliability of the first travel plan; to create a second travel plan of the vehicle based on one or two of the position of the vehicle, the environment surrounding the vehicle, and the state of the vehicle; to calculate a second reliability of the second travel plan; and to start the automatic driving control such that the vehicle travels based on the first travel plan when the first reliability of the first travel plan is equal to or higher than the second reliability of the second travel plan.

An automated driving system includes at least one electronic control unit configured to: recognize at least one obstacles around a vehicle, based on ambient surroundings of the vehicle; create a traveling plan of the vehicle, based on the ambient surroundings and a result of recognition of the at least one obstacles; control the vehicle using an actuator installed on the vehicle, based on the traveling plan; and perform, according to input from a user of the vehicle, overwriting operation to change the result of recognition of the at least one obstacles used for creation of the traveling plan.

Automated driving system

An autonomous driving device includes an autonomous driving release unit configured to release the autonomous driving control if an override operation is input during the execution of the autonomous driving control which is based on a first travel plan, a travel plan setting unit configured to set a second travel plan different from the first travel plan after the input of the override operation, an autonomous driving restore determination unit configured to determine whether or not to restore the autonomous driving control with the autonomous driving control which is based on the second travel plan after the input of the override operation, and a vehicle control unit configured to automatically start the autonomous driving control which is based on the second travel plan after the autonomous driving control is released and when the autonomous driving restore determination unit determines to restore the autonomous driving control.

An automatic driving system, that switches a driving state of a vehicle from automatic driving to manual driving due to a driver's operation during automatic driving of the vehicle, includes an electronic control unit configured to: determine whether a turning-off condition is satisfied when a direction indicator under the automatic driving is in a turned-on state and the driver's operation is performed; switch a driving state from the automatic driving to the manual driving and maintain the turned-on state of the direction indicator when the direction indicator is in the turned-on state and the driver's operation has been performed; determine whether the turning-off condition is satisfied based on a position of the vehicle under the manual driving or a traveling state of the vehicle under the manual driving; switch the direction indicator from the turned-on state to the turned-off state when it is determined that the turning-off condition is satisfied.

Growing community of inventors

Susono, Japan

Maiko Hirano