Sri International

Michael John Wolverton

William Scott Mark

Gokhan Tur

Horacio E Franco

Necip Fazil Ayan

Girish Acharya

Bart Peintner

Neil Yorke-Smith

Harry Bratt

Regis Vincent

Wen Wang

Andreas Kathol

Osher Yadgar

Venkatarama Satyanarayana Parimi

Rakesh Kumar

Norman D Winarsky

Supun Samarasekera

Andreas Stolcke

Gregory Kent Myers

Elizabeth E Shriberg

Douglas A Bercow

Martin Graciarena

Zhiwei Zhu

Dayne B Freitag

Edgar Kalns

Ryan Villamil

Thomas J Lee

Luciana Ferrer

Harpreet Singh Sawhney

Mayank Bansal

James R Carpenter

Jayakrishnan Kumar Eledath

Vlad Branzoi

Glenn Murray

Aaron Spaulding

Louise Yarnall

Supun Samarasekara

Ron Krakower

A computing system includes a vision-based user interface platform to, among other things, analyze multi-modal user interactions, semantically correlate stored knowledge with visual features of a scene depicted in a video, determine relationships between different features of the scene, and selectively display virtual elements on the video depiction of the scene. The analysis of user interactions can be used to filter the information retrieval and correlating of the visual features with the stored knowledge.

Real-time human-machine collaboration using big data driven augmented reality technologies

A computing system for virtual personal assistance includes technologies to, among other things, correlate an external representation of an object with a real world view of the object, display virtual elements on the external representation of the object and/or display virtual elements on the real world view of the object, to provide virtual personal assistance in a multi-step activity or another activity that involves the observation or handling of an object and a reference document.

Augmented reality virtual personal assistant for external representation

A method for assisting a user with one or more desired tasks is disclosed. For example, an executable, generic language understanding module and an executable, generic task reasoning module are provided for execution in the computer processing system. A set of run-time specifications is provided to the generic language understanding module and the generic task reasoning module, comprising one or more models specific to a domain. A language input is then received from a user, an intention of the user is determined with respect to one or more desired tasks, and the user is assisted with the one or more desired tasks, in accordance with the intention of the user.

Generic virtual personal assistant platform

A method and apparatus for training and guiding users comprising generating a scene understanding based on video and audio input of a scene of a user performing a task in the scene, correlating the scene understanding with a knowledge base to produce a task understanding, comprising one or more goals, of a current activity of the user, reasoning, based on the task understanding and a user's current state, a next step for advancing the user towards completing one of the one or more goals of the task understanding and overlaying the scene with an augmented reality view comprising one or more visual and audio representation of the next step to the user.

Method and apparatus for mentoring via an augmented reality assistant

The present invention relates to a method and apparatus for exploiting human feedback in an intelligent automated assistant. One embodiment of a method for conducting an interaction with a human user includes inferring an intent from data entered by the human user, formulating a response in accordance with the intent, receiving feedback from a human advisor in response to at least one of the inferring and the formulating, wherein the human advisor is a person other than the human user, and adapting at least one model used in at least one of the inferring and the formulating, wherein the adapting is based on the feedback.

Method and apparatus for exploiting human feedback in an intelligent automated assistant

A vehicle personal assistant to engage a user in a conversational dialog about vehicle-related topics, such as those commonly found in a vehicle owner's manual, includes modules to interpret spoken natural language input, search a vehicle knowledge base and/or other data sources for pertinent information, and respond to the user's input in a conversational fashion. The dialog may be initiated by the user or more proactively by the vehicle personal assistant based on events that may be currently happening in relation to the vehicle. The vehicle personal assistant may use real-time inputs obtained from the vehicle and/or non-verbal inputs from the user to enhance its understanding of the dialog and assist the user in a variety of ways.

Vehicle personal assistant that interprets spoken natural language input based upon vehicle context

The present invention relates to a method and apparatus for tailoring the output of an intelligent automated assistant. One embodiment of a method for conducting an interaction with a human user includes collecting data about the user using a multimodal set of sensors positioned in a vicinity of the user, making a set of inferences about the user in accordance with the data, and tailoring an output to be delivered to the user in accordance with the set of inferences.

Method and apparatus for tailoring the output of an intelligent automated assistant to a user

A platform for developing a virtual personal assistant ('VPA') application includes an ontology that defines a computerized structure for representing knowledge relating to one or more domains. A domain may refer to a category of information and/or activities in relation to which the VPA application may engage in a conversational natural language dialog with a computing device user. Re-usable VPA components may be linked to or included in the ontology. An ontology populating agent may at least partially automate the process of populating the ontology with domain-specific information. The re-usable VPA components may be linked with the domain-specific information through the ontology. A VPA application created with the platform may include domain-adapted re-usable VPA components that may be called upon by an executable VPA engine to determine a likely intended meaning of conversational natural language input of the user and/or initiate an appropriate system response to the input.

Rapid development of virtual personal assistant applications

Vehicle personal assistant

Growing community of inventors

Mountain View, CA, United States of America

Michael John Wolverton