Gm Cruise Holdings LLC

Livia Johanna

Theresa Foy

MinJie Tong

David J Shuckerow

Christopher Warren

Bharatkumar Patel

Leah Meyerholtz

Qingxuan Li

Yosser Andres D'Avanzo

Hailun Zhou

Bridget Collins

Kendal Sparks

Vinayaka Dattatraya

McKenna Morey

Alexander Willem Gerrese

Jennifer Devar McKnew

Bonnie Lin

Daniel Paul Thengvall

Steven Sturkop

Jyothi Babu Araja

There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the call, whereby the passenger can communicate with the other party via the call.

Human assisted live operations systems and methods

There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

A method of providing an onboard assistant for a vehicle, comprising: receiving sensor data from sensors of the vehicle; transforming the sensor data using a trained machine learning model to provide transformed sensor data; inferring from the transformed sensor data that a special condition for the vehicle requires intervention; and contacting an operator of the vehicle to inform the operator of the special condition and receive instructions for handling the special condition.

Automated inference of a customer support request in an autonomous vehicle

Assistance can be provided to users of AVs based on user sentiments. A system may receive a request for assistance from a user of an AV (e.g., a passenger of the AV). The system may also receive sensor data that is captured by a sensor suite of the AV from detecting the user, the AV, or another object. The system determines a sentiment of the user based on the sensor data. The system may input the sensor data into a machine learning model and the model outputs information indicating the user's sentiment. The system can determine who, when, or how to service the user's request based on the user's sentiment. The system may assign the user's request to an agent who can provide the assistance. The system can further provide guidance (e.g., suggested content of a conversation with the user) to the agent based on the user's sentiment.

System and method for providing support to user of autonomous vehicle (AV) based on sentiment analysis

There is disclosed a method of providing rider service for an autonomous vehicle (AV) system, including operating an AV to provide a trip to a passenger; associating the passenger with a unique passenger identifier (UPID); receiving passenger metadata for the passenger according to the UPID; and responding to a rider service instance, comprising customizing the response according to the UPID and the passenger metadata.

Personalized customer service for ridehail vehicle passengers

Assistance can be provided to AV users through projection of graphical figures. A system may receive a request for assistance from a user of an AV. The system assigns the request to an agent who can assist the user. The system further provides a graphical representation (e.g., an avatar) of the agent to a device that can project the graphical representation to the user. The user can have a conversation with the graphical representation, e.g., based on information provided by the agent. The system can also provide an audio filter to the device for modifying an audio content presented by the device so that the modified audio content appears as if it is made by the graphical representation. The device may be a part of the AV or a client device of the user that can present VR, AR, or MR content. The device may be mobile.

System and method for using virtual figures to support users of autonomous vehicles

Systems and methods for augmented in-vehicle experiences. In particular, systems and methods for an immersive in-vehicle experience are provided, with customizable virtual and augmented reality options. Systems and techniques are provided for vehicles to perform real-time detection and augmentation of the real world environment, including tracked objects and buildings in the real world environment. The vehicles use intelligently matched vehicle sensor data, map data, and other source data for detection and augmentation of the environment. In some examples, procedurally generated three-dimensional (3D) environments are provided, which are based on a current ride route and surrounding real world environment.

Augmented in-vehicle experiences

Systems and methods for targeted advertisements displayed on a vehicle. A dynamic advertising platform leverages various ridehail service modalities to present targeted advertisements to users and bystanders. The modalities can include ridehail applications, external vehicle screens, interior vehicle screens, and other in-car experience formats. The targeted advertisements can be selected based on various factors, which can be personalized based on the user as well as based on the advertising business's preferences.

Growing community of inventors

San Francisco, CA, United States of America

Livia Johanna