Cerence Operating Company

Mohammad Mehdi Moniri

Nils Lenke

Daniel Mario Kindermann

Reimund Schmald

Aditya Gulati

Donni McCray

Slawek Jarosz

Erland Unruh

Christophe Couvreur

Lior Ben-Gigi

Stefan Hamerich

Cassandra Lee

Christian Ardelean

Patrick Langer

Niels Does

Stefan Frank

Quynh Nguyen

A vehicle and many dynamic features move relative to the same reference frame. An infotainment system responds to a request from an occupant of a vehicle to provide information concerning a particular dynamic feature. The occupant provides the infotainment system with information concerning a bearing to the dynamic feature and the infotainment system identifies the dynamic feature in response.

Infotainment system having awareness of local dynamic features

While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database ('database') associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Method and apparatus for enhancing a geolocation database

Provided are a system and method of input to a computer in a vehicle. An electronic communication is formed between a first electronic device and a display of a second electronic device that is viewable by a user from a location in the vehicle, including providing by the first electronic device a first input mode for the second electronic device. A multimodal application is executed that permits the user to interact with the display of the second electronic device by a combination of the first input mode and at least one second input mode for the second electronic device. The combination of the first input mode and the at least one second input mode controls the display of the first electronic device.

Multimodal input processing for vehicle computer

An apparatus for entertaining an entertainee in a passenger vehicle includes an infotainment system having an automotive assistant that executes a spatially-cognizant entertainment application that interacts with the entertainee. In doing so, the automotive assistant receives information about the vehicle's environment from peripheral devices connected to the infotainment system. This provides the entertainment application with spatial intelligence that it then uses while interacting with the entertainee.

Automotive entertainment applications

A system and method of responding to a vocal utterance may include capturing and converting the utterance to word(s) using a language processing method, such as natural language processing. The context of the utterance and of the system, which may include multimodal inputs, may be used to determine the meaning and intent of the words.

Contextual utterance resolution in multimodal systems

While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database ('database') associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest ('POI') near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Some embodiments described herein relate to a multimodal user interface for use in an automobile. The multimodal user interface may display information on a windshield of the automobile, such as by projecting information on the windshield, and may accept input from a user via multiple modalities, which may include a speech interface as well as other interfaces. The other interfaces may include interfaces allowing a user to provide geometric input by indicating an angle. In some embodiments, a user may define a task to be performed using multiple different input modalities. For example, the user may provide via the speech interface speech input describing a task that the user is requesting be performed, and may provide via one or more other interfaces geometric parameters regarding the task. The multimodal user interface may determine the task and the geometric parameters from the inputs.

Growing community of inventors

Düsseldorf, Germany

Mohammad Mehdi Moniri