Sri International

Salesforce Com, Inc.

William Scott Mark

Michael John Wolverton

Kenneth C Nitz

Gokhan Tur

Horacio E Franco

Necip Fazil Ayan

Thierry Donneau-Golencer

Bart Peintner

Neil Yorke-Smith

Norman D Winarsky

Girish Acharya

Rajan Singh

Corey Hulen

Madhu Yarlagadda

Edgar Kalns

Elizabeth E Shriberg

Harry Bratt

Regis Vincent

Wen Wang

Andreas Kathol

Osher Yadgar

Venkatarama Satyanarayana Parimi

Patrick Denis Lincoln

Douglas A Bercow

Grit Denker

Rukman Senanayake

Karen L Myers

Steven S Weiner

Hung H Bui

Ajay Divakaran

Andreas Stolcke

Gregory Kent Myers

Amir Tamrakar

Dayne B Freitag

Martin Graciarena

Michael Frandsen

Luciana Ferrer

Min Yin

Thomas J Lee

Cory Albright

Jihua Huang

Michael Wessel

Hyong-Gyun Kim

Andreas Tsiartas

Greg Ho

Brent Mombourquette

Eric Law

Adam John Cheyer

James R Carpenter

David L Martin

James Frederick Arnold

Douglas B Moran

David A Salter

James F Carpenter

David Salter

Methods, computing devices, and computer-program products are provided for implementing a virtual personal assistant. In various implementations, a virtual personal assistant can be configured to receive sensory input, including at least two different types of information. The virtual personal assistant can further be configured to determine semantic information from the sensory input, and to identify a context-specific framework. The virtual personal assistant can further be configured to determine a current intent. Determining the current intent can include using the semantic information and the context-specific framework. The virtual personal assistant can further be configured to determine a current input state. Determining the current input state can include using the semantic information and one or more behavioral models. The behavioral models can include one or more interpretations of previously-provided semantic information. The virtual personal assistant can further be configured to determine an action using the current intent and the current input state.

VPA with integrated object recognition and facial expression recognition

A system may include multiple personal data sources and a machine-implemented data extractor and correlator configured to retrieve personal data from at least one of the personal data sources. The data extractor and correlator may extract information from unstructured data within the retrieved personal data and correlate the extracted information with previously stored structured data to generate additional structured data. The system may also include a storage device configured to store the previously stored structured data and the additional structured data. A natural language query module may be configured to receive a natural language query from a user and provide a response to the natural language query based at least in part on one or both of the previously stored structured data and the additional structured data.

Tools and techniques for extracting knowledge from unstructured data retrieved from personal data sources

A method for assisting a user with one or more desired tasks is disclosed. For example, an executable, generic language understanding module and an executable, generic task reasoning module are provided for execution in the computer processing system. A set of run-time specifications is provided to the generic language understanding module and the generic task reasoning module, comprising one or more models specific to a domain. A language input is then received from a user, an intention of the user is determined with respect to one or more desired tasks, and the user is assisted with the one or more desired tasks, in accordance with the intention of the user.

Generic virtual personal assistant platform

The present invention relates to a method and apparatus for exploiting human feedback in an intelligent automated assistant. One embodiment of a method for conducting an interaction with a human user includes inferring an intent from data entered by the human user, formulating a response in accordance with the intent, receiving feedback from a human advisor in response to at least one of the inferring and the formulating, wherein the human advisor is a person other than the human user, and adapting at least one model used in at least one of the inferring and the formulating, wherein the adapting is based on the feedback.

Method and apparatus for exploiting human feedback in an intelligent automated assistant

A device, method and system for automatically inferring a mobile user's current context includes applying a user activity knowledge base to real-time inputs and stored user-specific information to determine a current situation. Automated reasoning is used to infer a user-specific context of the current situation. Automated candidate actions may be generated and performed in accordance with the current situation and user-specific context.

Method, system and device for inferring a mobile user's current context and proactively providing assistance

A virtual personal assistant (VPA) application analyzes intents to, among other things, enhance or personalize a user's dialog experience with the VPA application. A set of intents, or multiple sets of intents, are maintained over the course of one or more user-specific dialog sessions with the VPA. Inferences may be derived from the set or sets of intents and incorporated into a current or future dialog session between the VPA and a user of the VPA application. In some embodiments, the inferences are only made available through the systemic understanding of natural language discourse by the VPA.

Using intents to analyze and personalize a user's dialog experience with a virtual personal assistant

A vehicle personal assistant to engage a user in a conversational dialog about vehicle-related topics, such as those commonly found in a vehicle owner's manual, includes modules to interpret spoken natural language input, search a vehicle knowledge base and/or other data sources for pertinent information, and respond to the user's input in a conversational fashion. The dialog may be initiated by the user or more proactively by the vehicle personal assistant based on events that may be currently happening in relation to the vehicle. The vehicle personal assistant may use real-time inputs obtained from the vehicle and/or non-verbal inputs from the user to enhance its understanding of the dialog and assist the user in a variety of ways.

Vehicle personal assistant that interprets spoken natural language input based upon vehicle context

A machine-implemented method for supporting a natural language user request against a user's personal data cloud can include a machine receiving the natural language user request from the user, determining a semantic interpretation of the natural language user request, querying a semantically-indexed, integrated knowledge store based on the semantic interpretation, and responding to the natural language user request by displaying results of the querying, wherein the results correspond to an item within the user's personal data cloud.

System and method for supporting natural language queries and requests against a user's personal data cloud

The present invention relates to a method and apparatus for tailoring the output of an intelligent automated assistant. One embodiment of a method for conducting an interaction with a human user includes collecting data about the user using a multimodal set of sensors positioned in a vicinity of the user, making a set of inferences about the user in accordance with the data, and tailoring an output to be delivered to the user in accordance with the set of inferences.

Method and apparatus for tailoring the output of an intelligent automated assistant to a user

Growing community of inventors

San Mateo, CA, United States of America

William Scott Mark