Gm Global Technolgoy Operations, Inc.

Other

Xu Fang Zhao

Gaurav Talwar

Md Foezur Rahman Chowdhury

Kenneth R Booker

Alaa M Khamis

Cody R Hansen

Scott M Pennock

Dustin H Smith

The concepts include a user support system in the form of a microphone, a visual display arranged in a vehicle cabin, and a controller. The controller includes an instruction set that is executable to receive, via the microphone, a voice-based request from a user, and employ a virtual assistant to determine a user interaction in real time and to determine a specific intent for the voice-based request, including capturing metadata. A user interaction routine determines a user interaction parameter associated with the virtual assistant based upon the voice-based request from the user. A user sentiment analysis routine determines a user satisfaction parameter associated with the virtual assistant based upon the voice-based request from the user. The controller responds in real-time to the voice-based request based upon the user satisfaction parameter and the user interaction parameter that are associated with the virtual assistant.

System and method for a voice-activated user support system

An automatic rain response system includes microphones of a vehicle, windshield wipers, and a controller. The microphones generate acoustic signals in response to rain. The controller is configured to receive a local weather condition, extract acoustic features from the acoustic signals, form feature vectors in response to the acoustic features and the local weather condition, classify the feature vectors to determine a current class among multiple classes, activate the windshield the wipers at a high speed in response to the current class being a heavy rain on a windshield class, activate the windshield wipers at a medium speed in response to the current class being a freezing rain on the windshield class, activate the windshield wipers at a low speed in response to the current class being a light rain on the windshield class, and deactivate the windshield wipers in response to the current class being a no rain class.

Automatic rain response system

A method for text feedback includes: receiving, by a controller, an utterance from a user; determining, by an automatic speech recognition engine of the controller, a plurality of speech recognition results based on the utterance from the user, wherein the speech recognition results include probable commands; determining, by the automatic speech recognition engine of the controller, a plurality of confidence scores for each of the plurality of speech recognition results; determining, by the controller, a text characteristic for each of the plurality of probable commands as a function of the confidence scores for each of the plurality of speech recognition results; and commanding, by the controller, a display to show text corresponding to each of the plurality of probable commands with the text characteristic determined by the controller.

Intelligent text and voice feedback for voice assistant

A method and associated system for recognizing speech using multiple speech recognition algorithms. The method includes receiving speech at a microphone installed in a vehicle, and determining results for the speech using a first algorithm, e.g., embedded locally at the vehicle. Speech results may also be received at the vehicle for the speech determined using a second algorithm, e.g., as determined by a remote facility. The results for both may include a determined speech topic and a determined speech slotted value, along with corresponding confidence levels for each. The method may further include using at least one of the determined first speech topic and the received second speech topic to determine the topic associated with the received speech, even when the first speech topic confidence level of the first speech topic, and the second speech topic confidence level of the second speech topic are both a low confidence level.

Speech recognition arbitration logic

A system and method of generating a natural language generation (NLG) output, wherein the method includes: receiving speech signals from a user at a microphone of a client device; determining a requested communication goal and at least one inputted communication value based on the received speech signals; determining to use a static natural language generation (NLG) template or a dynamic NLG template to generate an NLG output, wherein the determination of whether to use a static NLG template or a dynamic NLG template is made using a neural network NLG template selection process; selecting an NLG template after the determination of whether to use a static NLG template or a dynamic NLG template; and generating an NLG output based on the selected NLG template.

Natural language generation based on user speech style

An infotainment system of a vehicle includes: a primary intent module configured to determine a primary intent included in voice input using automated speech recognition (ASR); and an execution module configured to, via a first hardware output device of the vehicle, execute the primary intent. A secondary intent module is configured to: based on the primary intent, determine a first domain of the primary intent; based on the first domain of the primary intent, determine a second domain; and based on the voice input and the second domain, determine a secondary intent included in the voice input using ASR. A display control module is configured to display a request for user input indicative of whether to execute the secondary intent. The execution module is further configured to, via a second hardware output device of the vehicle, execute the secondary intent in response to user input to execute the secondary intent.

Vehicle control systems and methods for multi-intent queries input by voice

A method for recognizing speech in a vehicle includes receiving speech at a microphone installed to a vehicle, and determining whether the speech includes a navigation instruction. If the speech includes a navigation instruction, the speech may be sent to a remote facility. After sending the speech to the remote facility, a local speech recognition result is provided in the vehicle to the user. The speech sent to the remote facility may be used to provide corrective action. A system for recognizing speech in a vehicle may include a microphone, and may be configured to determine a local speech recognition result from the speech command and determine when the speech command includes a navigation instruction. The system may further include a remote server in communication with the vehicle that receives a sample of the speech command from the speech recognition system when the speech command includes a navigation instruction.

Enhanced voice recognition task completion

A processor receives a broadcast in a vehicle, select audio data from the broadcast, processes the audio data selected from the broadcast, determines a phonetic pattern of the selected audio data based on the processing, selects additional instances of audio data from the broadcast that resemble the selected audio data, processes the additional instances of audio data from the broadcast, determine phonetic patterns of the additional instances of audio data, and selects a plurality of phonetic patterns from the phonetic pattern of the selected audio data and the phonetic patterns of the additional instances of audio data. A transmitter transmits the plurality of phonetic patterns to a server to determine an optimal pronunciation of the selected audio data based on a statistical analysis of the plurality of phonetic patterns and to add the optimal pronunciation of the selected audio data to a database used to recognize speech in the vehicle.

Persistent training and pronunciation improvements through radio broadcast

One general aspect includes a system for responsive activation of a vehicle feature for a vehicle, the system includes: an audio system configured to announce information and the vehicle feature; a memory configured to include one or more executable instructions; a controller configured to execute the executable instructions, and where the executable instructions enable the controller to: receive speech inputs from a vehicle occupant located in the vehicle, the speech inputs regarding the vehicle feature; retrieve vehicle feature information from vehicle feature information databases, in response to the received speech inputs; provide audio description information for the vehicle feature information; determine whether at least one received speech input includes a feature activation request; provide vehicle feature activation information to the vehicle feature, in response to a positive determination that the at least one received speech input includes the feature activation request.

Responsive activation of a vehicle feature

A system and method of changing features of an existing automatic speech recognition (ASR) system includes: monitoring speech received from a vehicle occupant for one or more keywords identifying a feature to remove from or add to the ASR system; detecting the keywords in the monitored speech; and adding the identified feature to or removing the identified feature from from the ASR system.

Dynamically adding or removing functionality to speech recognition systems

Methods and systems are provided for facilitating communication within vehicles. In accordance with one embodiment, a vehicle includes a passenger cabin, a receiver, and a processor. The receiver is configured to receive signals, within the passenger cabin, from one more electronic device microphones inside the passenger cabin. Each of the electronic device microphones comprises a microphone of an electronic device of a user inside the passenger cabin. The processor is coupled to the receiver, and is configured to at least facilitate generating one or more zones of communication using the received signals from the electronic device microphones inside the passenger cabin.

Vehicle use of microphones of user'S smart wearables

Methods and systems for controlling audio communications between occupants of a vehicle are provided. In accordance with one embodiment, a system includes an interface and a processor. The interface is configured to at least facilitate receiving a request for sound transmission from a first occupant inside a vehicle to a second occupant inside the vehicle. The processor is coupled to the interface, and is configured to at least facilitate identifying respective locations of the first occupant and the second occupant, and performing the sound transmission with an adjustment for a phase difference based at least in part on the respective locations of the first occupant and the second occupant.

Growing community of inventors

LaSalle, Canada

Xu Fang Zhao