Google Inc.

Waymo LLC

Nuro Corp.

Other

X Development LLC

Atlassian Corporation Pty Ltd.

Atlassian Inc.

Jiajun Zhu

David Ian Ferguson

Dmitri A Dolgov

Christopher Paul Urmson

Pichayut Jirapinyo

Nathaniel Fairfield

Nan Ransohoff

Dirk Haehnel

Cosimo Leipold

Russell Leigh Smith

Pierre-Yves Droz

Jonathan Baldwin Dowdall

Luc Vincent

Daniel Joseph Filip

Dave Ferguson

Michael Steven Montemerlo

Bradley Templeton

David Ian Franklin Ferguson

Andrew Hughes Chatham

James Stout

Pratik Agarwal

Hendrik Dahlkamp

Carl Nygaard

Yi Shen

Abhijit S Ogale

Ian James Mahon

Calvin Giroud

Qunyan Pu

Nick Vines

Manuel Christian Clement

Luke Wachter

Donald Jason Burnette

Dorel Ionut Iordache

Taylor Pechacek

Benjamin Wade Julian

Peter Morton

Steven Adam Berry

Aleksey S Boyko

Patrick Hill

Henrik Kretzschmar

Kelvin Yap

Daniel Salet

Jessica Brooke

Ben Julian

Andrei Bocan

Dharam Gollapudi

James Bobowski

Sarah Bland

Shivam Dave

Tré Lannon

According to one aspect, a method includes obtaining a request to remotely operate a robotic assistant, the robotic assistant including at least one sensor configured to collect data associated with an environment around the robotic assistant. The method also includes identifying a first teleoperations system to remotely operate the robotic assistant in response to the request, the first teleoperations system being one of a plurality of teleoperations systems, and assigning the first teleoperations system to remotely operate the robotic assistant. At least one privacy-related instruction is implemented with respect to the first teleoperations system.

Framework for robotic assistants

Methods and systems are disclosed for cross-validating a second sensor with a first sensor. Cross-validating the second sensor may include obtaining sensor readings from the first sensor and comparing the sensor readings from the first sensor with sensor readings obtained from the second sensor. In particular, the comparison of the sensor readings may include comparing state information about a vehicle detected by the first sensor and the second sensor. In addition, comparing the sensor readings may include obtaining a first image from the first sensor, obtaining a second image from the second sensor, and then comparing various characteristics of the images. One characteristic that may be compared are object labels applied to the vehicle detected by the first and second sensor. The first and second sensors may be different types of sensors.

Cross-validating sensors of an autonomous vehicle

Provided herein is an autonomous or semi-autonomous vehicle fleet comprising a plurality of electric autonomous vehicles for apportioned display of a media, operating autonomously and a fleet management module for coordination of the autonomous vehicle fleet. Each autonomous or semi-autonomous vehicle comprising a screen configured to display the media. Activation, deactivation, brightness modification, in combination with specific media selection enables more efficient media display.

Method and apparatus for displaying media on an autonomous vehicle

A method and apparatus are provided for determining one or more behavior models used by an autonomous vehicle to predict the behavior of detected objects. The autonomous vehicle may collect and record object behavior using one or more sensors. The autonomous vehicle may then communicate the recorded object behavior to a server operative to determine the behavior models. The server may determine the behavior models according to a given object classification, actions of interest performed by the object, and the object's perceived surroundings.

Automated system and method for modeling the behavior of vehicles and other agents

Methods and devices for actively modifying a field of view of an autonomous vehicle in view of constraints are disclosed. In one embodiment, an example method is disclosed that includes causing a sensor in an autonomous vehicle to sense information about an environment in a first field of view, where a portion of the environment is obscured in the first field of view. The example method further includes determining a desired field of view in which the portion of the environment is not obscured and, based on the desired field of view and a set of constraints for the vehicle, determining a second field of view in which the portion of the environment is less obscured than in the first field of view. The example method further includes modifying a position of the vehicle, thereby causing the sensor to sense information in the second field of view.

Actively modifying a field of view of an autonomous vehicle in view of constraints

A method and apparatus are provided for optimizing one or more object detection parameters used by an autonomous vehicle to detect objects in images. The autonomous vehicle may capture the images using one or more sensors. The autonomous vehicle may then determine object labels and their corresponding object label parameters for the detected objects. The captured images and the object label parameters may be communicated to an object identification server. The object identification server may request that one or more reviewers identify objects in the captured images. The object identification server may then compare the identification of objects by reviewers with the identification of objects by the autonomous vehicle. Depending on the results of the comparison, the object identification server may recommend or perform the optimization of one or more of the object detection parameters.

System and method for evaluating the perception system of an autonomous vehicle

Aspects of the invention relate generally to autonomous vehicles. The features described improve the safety, use, driver experience, and performance of these vehicles by performing a behavior analysis on mobile objects in the vicinity of an autonomous vehicle. Specifically, the autonomous vehicle is capable of detecting nearby objects, such as vehicles and pedestrians, and is able to determine how the detected vehicles and pedestrians perceive their surroundings. The autonomous vehicle may then use this information to safely maneuver around all nearby objects.

System and method for predicting behaviors of detected objects through environment representation

A delivery system includes a database configured to store information of a customer where the information includes a default payment method, a communication system configured to communicate with an autonomous vehicle and with a device of the customer, where the device includes a display screen having a button to summon an autonomous vehicle, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, cause the delivery system to receive an indication via the communication system that the button on the device of the customer has been clicked, and instruct the autonomous vehicle to travel to a location of the customer.

Systems and methods for one-click delivery of autonomous vehicle

A vehicle configured to operate in an autonomous mode may operate a sensor to determine an environment of the vehicle. The sensor may be configured to obtain sensor data of a sensed portion of the environment. The sensed portion may be defined by a sensor parameter. Based on the environment of the vehicle, the vehicle may select at least one parameter value for the at least one sensor parameter such that the sensed portion of the environment corresponds to a region of interest. The vehicle may operate the sensor, using the selected at least one parameter value for the at least one sensor parameter, to obtain sensor data of the region of interest, and control the vehicle in the autonomous mode based on the sensor data of the region of interest.

Modifying the behavior of an autonomous vehicle using context based parameter switching

A system and method include scanning a light detection and ranging (LIDAR) device through a range of orientations corresponding to a scanning zone while emitting light pulses from the LIDAR device. The method also includes receiving returning light pulses corresponding to the light pulses emitted from the LIDAR device and determining initial point cloud data based on time delays between emitting the light pulses and receiving the corresponding returning light pulses and the orientations of the LIDAR device. The initial point cloud data has an initial angular resolution. The method includes identifying, based on the initial point cloud data, a reflective feature in the scanning zone and determining an enhancement region and an enhanced angular resolution for a subsequent scan to provide a higher spatial resolution in at least a portion of subsequent point cloud data from the subsequent scan corresponding to the reflective feature.

Wide-view LIDAR with areas of special attention

Methods and systems are disclosed for determining sensor degradation by actively controlling an autonomous vehicle. Determining sensor degradation may include obtaining sensor readings from a sensor of an autonomous vehicle, and determining baseline state information from the obtained sensor readings. A movement characteristic of the autonomous vehicle, such as speed or position, may then be changed. The sensor may then obtain additional sensor readings, and second state information may be determined from these additional sensor readings. Expected state information may be determined from the baseline state information and the change in the movement characteristic of the autonomous vehicle. A comparison of the expected state information and the second state information may then be performed. Based on this comparison, a determination may be made as to whether the sensor has degraded.

Detecting sensor degradation by actively controlling an autonomous vehicle

An autonomous vehicle is tested using virtual objects. The autonomous vehicle is maneuvered, by one or more computing devices, the autonomous vehicle in an autonomous driving mode. Sensor data is received corresponding to objects in the autonomous vehicle's environment, and virtual object data is received corresponding to a virtual object in the autonomous vehicle's environment. The virtual object represents a real object that is not in the vehicle's environment. The autonomous vehicle is maneuvered based on both the sensor data and the virtual object data. Information about the maneuvering of the vehicle based on both the sensor data and the virtual object data may be logged and analyzed.

Simulating virtual objects

A method and apparatus is provided for controlling the operation of an autonomous vehicle. According to one aspect, the autonomous vehicle may track the trajectories of other vehicles on a road. Based on the other vehicle's trajectories, the autonomous vehicle may generate a pool of combined trajectories. Subsequently, the autonomous vehicle may select one of the combined trajectories as a representative trajectory. The representative trajectory may be used to change at least one of the speed or direction of the autonomous vehicle.

Approach for consolidating observed vehicle trajectories into a single representative trajectory

Growing community of inventors

Sunnyvale, CA, United States of America

Jiajun Zhu