Waymo LLC

Google Inc.

Carl Nygaard

James Stout

Alexander Ruben Stacey McCarthy

Jiajun Zhu

Yiwen Xu

Dudley Carr

Zhenzhen Liu

Constantin Scholl

The disclosure relates to testing software for operating an autonomous vehicle. For instance, a first simulation may be run. The simulation may be run using the software to control a simulated vehicle and at least one agent. During the running of the first simulation, whether a particular type of interaction between the simulated vehicle and the at least one agent has occurred may be determined. In response to this determination, a second simulation may be run using the log data by replacing the at least one agent with a model agent that simulates a road user capable of responding to actions performed by the simulated vehicle. The second simulation may be used to determine in order to determine whether the software is able to complete the second simulation without the particular type of interaction between a second simulated vehicle and the model agent occurring.

Collision evaluation for log-based simulations

The technology relates to generating simulations in order to evaluate software used to control vehicles in an autonomous driving mode. In one example, an initial situation involving a certain kind of interaction between a vehicle operating in the autonomous driving mode and an object may be identified. A search of log data may be conducted in order to identify one or more similar situations based on characteristics of the initial situation. A new simulation may be generated using the identified one or more similar situations by inserting the object into the one or more similar situations. The new simulation may be run in order to evaluate the software.

Realism in log-based simulations

An autonomous vehicle is tested using virtual objects. The autonomous vehicle is maneuvered, by one or more computing devices, the autonomous vehicle in an autonomous driving mode. Sensor data is received corresponding to objects in the autonomous vehicle's environment, and virtual object data is received corresponding to a virtual object in the autonomous vehicle's environment. The virtual object represents a real object that is not in the vehicle's environment. The autonomous vehicle is maneuvered based on both the sensor data and the virtual object data. Information about the maneuvering of the vehicle based on both the sensor data and the virtual object data may be logged and analyzed.

Simulating virtual objects

The disclosure relates to testing software for operating an autonomous vehicle. For instance, a first simulation may be run using log data and the software to control a first simulated vehicle. During this, one or more characteristics of the simulated vehicle may be compared with one or more characteristics of a vehicle from the log data. The comparison may be used to determine a divergence point for starting a timer. In addition, a second simulation may be run using the log data and the software to control a second simulated vehicle. The divergence point may be used to determine a handover time to allow the software to take control of the second simulated vehicle. Whether the software is able to continue through the first simulation before the timer expires without a particular type of event occurring and/or the second simulation without the particular type of event occurring is determined.

Using divergence to conduct log-based simulations

The disclosure relate to testing software for operating an autonomous vehicle. For instance, a first simulation may be run. The simulation may be run using the software to control a simulated vehicle and at least one agent. During the running of the first simulation, whether a particular type of interaction between the simulated vehicle and the at least one agent has occurred may be determined. In response to this determination, a second simulation may be run using the log data by replacing the at least one agent with a model agent that simulates a road user capable of responding to actions performed by the simulated vehicle. The second simulation may be used to determine in order to determine whether the software is able to complete the second simulation without the particular type of interaction between a second simulated vehicle and the model agent occurring.

The disclosure relate to testing software for operating an autonomous vehicle. For instance, a first simulation may be run using log data and the software to control a first simulated vehicle. During this, one or more characteristics of the simulated vehicle may be compared with one or more characteristics of a vehicle from the log data. The comparison may be used to determine a divergence point for starting a timer. In addition, a second simulation may be run using the log data and the software to control a second simulated vehicle. The divergence point may be used to determine a handover time to allow the software to take control of the second simulated vehicle. Whether the software is able to continue through the first simulation before the timer expires without a particular type of event occurring and/or the second simulation without the particular type of event occurring is determined.

Embodiments relate to determining the number of unique users of computer software without individually identifying users with a unique identification. In an embodiment, data elements are communicated from clients to a server. Each data element contains the number of days that have elapsed since the last communication from the client to the server. Based on the communicated data elements and the time and date at which each data element is received, the server can determine a count of unique users over a specified time period.

Growing community of inventors

Sunnyvale, CA, United States of America

Carl Nygaard