Cerence Operating Company

Nuance Communications, Inc.

U.S. Philips Corporation

Koninklijke Philips Electronics N.v.

Philips Intellectual Property & Standards Gmbh

Nils Lenke

Mohammad Mehdi Moniri

Johan Wouters

Reimund Schmald

Christophe Couvreur

William F Ganong, Iii

Paul Joseph Vozila

Charles L Ortiz, Jr

Daniel Mario Kindermann

Duygu Kanver

Marina Matveevskaia

Wilson Tam

Adam Emfield

Sumanta Chakraborty

Jan Kleindienst

Ladislav Kunc

Martin Labsky

Tomas Macek

Christian Benien

Donni McCray

Erland Unruh

Oliver Bender

Jan Vystrcil

Binh Dac Nguyen

Lior Ben-Gigi

Kuldeep Singh

Stefan Hamerich

Henrik Hodam

Christian Ardelean

Michael Kaisser

Eric Montague

Niels Does

Dhruv Gupta

Robert M Policano

Éric Lesage

Vanessa Tobisch

Prasad Mandge

Ketan Kankapure

Aditya Chauhan

Kalpeshkumar Bhanubhai Patel

Stefan Frank

Quynh Nguyen

Abbas Vanak

Mustafa Turker Firik

Rahel Flechtner

Karina Sonja Wirth

Jorg Ockel

Stephan Gamm

Reimund Emil Schmald

An apparatus comprising an infotainment system including a proactive automotive assistant that executes a first action and a second action, wherein the first action is that of permitting spontaneous communication to an occupant in a vehicle and the second action is that of providing information indicating that spontaneous communication with the occupant is impermissible. The automotive assistant is configured to receive information selected from the group consisting of vehicle-status information concerning operation of the vehicle and occupant-status information concerning the occupant and to base the first and second actions at least in part on the information.

Proactive automotive assistant

A vehicle control system executing a voice control system for facilitating voice-based dialog with a driver to enable the driver or autonomous vehicle to control certain operational aspects of an autonomous vehicle is provided. Using environmental and sensor input, the vehicle control system can select optimal routes for operating the vehicle in an autonomous mode or choose a preferred operational mode. Occupants of the autonomous vehicle can change a destination, route or driving mode by engaging with the vehicle control system in a dialog enabled by the voice control system.

Methods and systems for increasing autonomous vehicle safety and flexibility using voice interaction

Touring circuitry for managing an immersion tour as a vehicle traverses a path through a touring theatre receives location information and provides control signals to an augmented-reality system based on a location of the vehicle in the touring theater. The control signals cause the augmented-reality system to stimulate at least two sensory inputs of a passenger.

Touring circuitry for an immersive tour through a touring theater

A biometric corroborator receives an enhanced sound file, a vehicular data provided by a vehicle, and telemetry data provided by the vehicle to a telematics server. It then uses these to corroborate each other before deciding whether to authenticate a proposed transaction.

Safe authentication from an automobile

An automotive processing unit includes an infotainment system having a speech interface, an application suite comprising one or more spatially-cognizant applications, and an automotive assistant that is configured to execute one or more of the spatially-cognizant applications. The speech interface is configured to receive a navigation announcement from a navigator and a touring announcement from one of the spatially-cognizant applications and, in response, to cause a spoken announcement to be made audible in a vehicle's cabin through a loudspeaker. The spoken announcement comprising content from at least one of the touring announcement and the navigation announcement.

Automotive infotainment system with spatially-cognizant applications that interact with a speech interface

While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database ('database') associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Method and apparatus for enhancing a geolocation database

Provided are a system and method of input to a computer in a vehicle. An electronic communication is formed between a first electronic device and a display of a second electronic device that is viewable by a user from a location in the vehicle, including providing by the first electronic device a first input mode for the second electronic device. A multimodal application is executed that permits the user to interact with the display of the second electronic device by a combination of the first input mode and at least one second input mode for the second electronic device. The combination of the first input mode and the at least one second input mode controls the display of the first electronic device.

Multimodal input processing for vehicle computer

A haptic-communication system includes a fabric, a frame that supports the fabric, and a haptic element that is integral with a textile that forms the fabric. A transition of the haptic element between first and second states thereof provides communication with a person in contact with the haptic element.

Haptic communication with a vehicle's occupant

While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database ('database') associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest ('POI') near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

A method, computer program product, and computing system for receiving a verbal command, from a user, on a vehicle infotainment system, wherein the vehicle infotainment system is configured to interface with an external system. A preferred system is identified for executing the verbal command. The verbal command is routed to the preferred system, wherein the preferred system is selected from the vehicle infotainment system and the external system.

Selection system and method

A method, computer program product, and computing system for monitoring an interior environment of a motor vehicle; determining a personal state of an occupant within the interior environment of the motor vehicle; and interacting with the occupant based, at least in part, upon the personal state of the occupant.

Interaction system and method

Some embodiments described herein relate to a multimodal user interface for use in an automobile. The multimodal user interface may display information on a windshield of the automobile, such as by projecting information on the windshield, and may accept input from a user via multiple modalities, which may include a speech interface as well as other interfaces. The other interfaces may include interfaces allowing a user to provide geometric input by indicating an angle. In some embodiments, a user may define a task to be performed using multiple different input modalities. For example, the user may provide via the speech interface speech input describing a task that the user is requesting be performed, and may provide via one or more other interfaces geometric parameters regarding the task. The multimodal user interface may determine the task and the geometric parameters from the inputs.

Multimodal user interface for a vehicle

A system, method and computer-readable storage device are disclosed for managing a mute and unmute feature on a device which is used to communicate data in a communication conference. The method includes detecting, when the device is set to mute, whether the user is speaking and whether the speech is meant for the conference. Background noises are distinguished from the speech of the user. If the user is speaking and the device is set to mute, the device will automatically switch to and unmute setting such that people in the indication conference can hear the user speak. Facial recognition, and gaze detection or other data can also be used to determine when to automatically mute or unmute the device and can aid in inferring an intent of the user to speak to the conference participants.

System and method for managing a mute button setting for a conference call

Provided are a system and method of mixing a second audio stream with a first audio stream in an audio output device. The system is configured to execute the method, comprising buffering and outputting the first audio stream via the audio output device as unmodified output, determining at least one insertion spot within the first audio stream, modifying the first audio stream at an insertion spot to avoid content loss, outputting the second audio stream at the insertion spot, and resuming unmodified output of the first audio stream at or near a completion of the second audio stream. Modifying the first audio stream can include pausing and/or warping the first audio stream at the insertion spot. The audio output device can be a vehicle head unit or a wireless device, such as a mobile phone.

Audio stream mixing system and method

Growing community of inventors

Rheinbach, Germany

Nils Lenke