Zoox, Inc.

Meredith James Goldman

Ravi Verma Gogna

Frank Reinaldo Ramirez

Dennis Schaefer

Matthew Miller Young

Timothy Caldwell

Paul Orecchio

Rick Zhang

Niroth Keo

Edward William O'Donnell

Wenhao Sheng

Muhammad Umar Choudry

Gerardo Cid Fernandez

Liang Chao

A computer implemented method is provided. The method, comprises: receiving from an autonomous vehicle sensor data, wherein the sensor data is indicative of an environment in which the vehicle is currently located or was previously located. The method further comprises receiving or determining additional data associated with at least one of: the sensor data, the vehicle, or the environment, wherein the additional data is different from the sensor data. The method further comprises displaying, on a display, an output comprising a representation of the sensor data. The method further comprises determining, based at least in part on the additional data, a reliability metric, the reliability metric being indicative of how reliable the sensor data is at representing the environment in which the vehicle is located at a current time. The method further comprises causing the output on the display to be based at least in part on the reliability metric.

Scene reliability

Display screen or portion thereof having a graphical user interface

The present disclosure is directed to systems and techniques for controlling an autonomous vehicle. While the autonomous vehicle is travelling to a destination, the autonomous vehicle may encounter a situation preventing the autonomous vehicle from travelling to the destination. A control center may receive information from the autonomous device and use a graphical user interface to provide instructions with limited controls for the autonomous vehicle to navigate to an intermediate position. In such an intermediate position, the vehicle may make way for an emergency vehicle, obtain additional sensor data for continued autonomous planning, signal intent to other objects in the environment, and the like.

System and method for controlling an autonomous vehicle

A vehicle computing system may identify an obstruction along a route of travel and may connect to a service computing device for guidance. The service computing device may include a guidance system configured to receive waypoint and/or orientation input from an operator. The operator may evaluate the scenario and determine one or more waypoints and/or associated orientations for the vehicle to navigate the scenario. In some examples, the guidance system may validate the waypoint(s) and/or associated orientation(s). The service computing device may send the waypoint(s) and/or associated orientation(s) to the vehicle computing system. The vehicle computing system may validate the waypoint(s) and/or associated orientation(s) and, based on the validation, control the vehicle according to the input. Based on a determination that the vehicle has navigated the scenario, the guidance system may release vehicle guidance back to the vehicle computing system.

Remote vehicle guidance

Aspects of validating information sent to and/or received by a computing device, such as a vehicle computing device, are discussed herein. A vehicle may receive information associated with a computing device, the information indicating that the computing device is authorized to provide guidance information to an autonomous vehicle. Further, the vehicle can receive a message comprising the guidance information associated with the autonomous vehicle. The vehicle can determine that the message is associated with the computing device and can evaluate the message based at least in part on configuration data associated with maneuvering the autonomous vehicle or state information associated with the autonomous vehicle. The vehicle can be controlled based at least in part on evaluating the message.

Guidance authentication with vehicles

A vehicle may include an authority tracker to grant and/or limit authority to provide guidance to the vehicle. The authority tracker may store a state in a memory identifying an actor that currently has the authority. An actor requesting to have authority to provide guidance to the vehicle may transmit a control message to the authority tracker which may, in turn, authorize or deny the request based on a policy. The authority tracker may periodically, and/or in response to a request, broadcast a state message identifying the actor that currently has authority, as recorded in the memory.

Autonomous vehicle guidance authority framework

Display screen or portion thereof having an animated graphical user interface

A vehicle computing system may identify a scenario in an environment that violates an operating constraint. The vehicle computing system may request remote guidance from a guidance system of a service computing device. The vehicle computing system may receive input from the guidance system including one or more waypoints and/or associated orientations for the vehicle to navigate through the scenario. The vehicle computing system may be configured to validate the input. A validation may include processing the input to determine whether the waypoint(s) and/or orientation(s) associated therewith may cause the vehicle to violate a safety protocol. Based on a determination that the input will not cause the vehicle to violate the safety protocol, the vehicle computing system may control the vehicle according to the input, such as by causing a drive system to operate the vehicle to each waypoint at the associated orientation.

Vehicle control and guidance

The present disclosure is directed to systems and techniques for providing a teleoperation instruction to an autonomous vehicle. While the autonomous vehicle is travelling to a destination, the autonomous vehicle may encounter a situation preventing the autonomous vehicle from travelling to the destination. A control center may receive information from the autonomous device and provide instructions with limited controls for the autonomous vehicle to navigate to an intermediate position. In such an intermediate position, the may make way for an emergency vehicle, obtain additional sensor data for continued autonomous planning, signal intent to other objects in the environment, and the like.

System and method for providing a teleoperation instruction to an autonomous vehicle

Techniques to provide guidance to a vehicle operating in an environment may include determining a suggested region to block in the environment along a path of the vehicle and causing presentation of the suggested region to block in a user interface of the computer device. Information about the blocked region may be transmitted to one or more vehicles in the environment. Based on the information about the blocked region, at least one of the computer device or a vehicle computer system of the vehicle may control operation of the vehicle to avoid the blocked region.

Blocked region guidance

Techniques and methods for navigating an autonomous vehicle using teleoperator instructions. For instance, while navigating to a location, progress of an autonomous vehicle may stop. This may be caused by the autonomous vehicle yielding to another vehicle, such as at an intersection or when the other vehicle is located along a route of the autonomous vehicle. After yielding for a threshold amount of time, the autonomous vehicle may send sensor data and/or an indication of the other vehicle to the teleoperator. The autonomous vehicle may then receive, from the teleoperator, an instruction to cease yielding to the other vehicle. Based at least in part on the instruction, the autonomous vehicle may again begin navigating.

Techniques for navigating vehicles using teleoperator instructions

Techniques and methods for contacting a teleoperator. For instance, while navigating to a location, progress of an autonomous vehicle may stop. This may be caused by the autonomous vehicle yielding to another vehicle, such as at an intersection or when the other vehicle is located along a route of the autonomous vehicle. While yielding to the other vehicle, the autonomous vehicle may determine that the progress has stopped for a threshold amount of time. Additionally, in some circumstances, the autonomous vehicle may determine that the progress not been stopped due to traffic or a traffic light. Based at least in part on the determinations, the autonomous vehicle may send sensor data to the teleoperator, where the sensor data represents an environment for which the autonomous vehicle is located. Additionally, the autonomous vehicle may send an indication of the other vehicle to the teleoperator.

Growing community of inventors

Redwood City, CA, United States of America

Meredith James Goldman