Waymo LLC

Vasily Starostenko

Keith Hutchings

Ilmo Van Der Lowe

Nirmal Jitendra Patel

Julien Charles Mercay

Ganesh Balachandran

Samrat Kansara

Andrew Warren

Aspects of the disclosure relate to testing situational awareness of a test driver tasked with monitoring the driving of a vehicle operating in an autonomous driving mode. For instance, a signal that indicates that the test driver may be distracted may be identified. Based on the signal, that a question can be asked of the test driver may be determined. A plurality of factors relating to a driving context for the vehicle may be identified. Based on the determination, a question may be generated based on the plurality of factors. The question may be provided to the test driver. Input may be received from the test driver providing an answer to the question.

Testing situational awareness of drivers tasked with monitoring a vehicle operating in an autonomous driving mode

Aspects of the disclosure relate to analyzing head movements in a test driver tasked with monitoring the driving of a vehicle operating in an autonomous driving mode. For instance, a sensor may be used to capture sensor data of a test driver's head for a period of time. The sensor data may be analyzed to determine whether the test driver's head moved sufficiently enough to suggest that the test driver is engaged in monitoring the driving of the vehicle. Based on the determination of whether the test driver's head moved sufficiently enough, an intervention response may be initiated.

Monitoring head movements of drivers tasked with monitoring a vehicle operating in an autonomous driving mode

Assessing a likelihood of a person experiencing a fatigue event when the person tasked with monitoring a vehicle operating in an autonomous driving mode may include receiving a set of response times for a psychomotor vigilance test administered to the person. The test may include a plurality of trials which involve a person lifting a finger from a user input device. Whether the person passed or failed each trial of the set of trials may be determined. A model trained using data from prior psychomotor vigilance tests administered to the person may be identified for the person. Results of the determinations of whether the person passed or failed each trial of the set of trials may be input into the model in order to determine a value representative of a likelihood of a fatigue event. An intervention response may be initiated based on the value.

Psychomotor vigilance testing for persons tasked with monitoring autonomous vehicles

Aspects of the disclosure relate to models for estimating the likelihood of fatigue in test drivers. In some instances, training data including videos of the test drivers while such test drivers are tasked with monitoring driving of a vehicle operating in an autonomous driving mode may be identified. The training data also includes driver drowsiness values generated from one or more human operators observing the videos. The training inputs and outputs may be used to train the model such that when a new video of a first test driver is input into the model, the model will output an estimate of a likelihood of fatigue for that test driver.

Growing community of inventors

San Jose, CA, United States of America

Vasily Starostenko