Microsoft Technology Licensing, LLC

Hailong Mu

Emmanouil Koukoumidis

Joseph Edwin Johnson, Jr

Kai Wang

Jun Hong Zhao

Zeyong Xu

Ying Wang

Edward Ding-Bong Un

Dustin Isaac Abramson

Donald Brinkman

Hudong Wang

Di Li

Kati Amanda London

Zhan Chen

Matthew W Schuerman

Steven G Zittrower

Kelli A Stuckart

Maria A Rangel

Pengfei Hao

Xianchao Wu

Oussama Elachqar

Maria Alexandropoulou

Daniel Vann

Dan Vann

Zhiyang Su

Youssef Hammad

Joseph Edwin Johnson

The present disclosure provides method and apparatus for providing a response to a user in a session. At least one message associated with a first object may be received in the session, the session being between the user and an electronic conversational agent. An image representation of the first object may be obtained. Emotion information of the first object may be determined based at least on the image representation. A response may be generated based at least on the at least one message and the emotion information. The response may be provided to the user.

Providing a response in a session

Aspects of the present disclosure provide systems and methods for detecting memorable events of a user, storing those memorable events in a user profile, and leveraging those events to the user. In so doing, memorable events with positive emotional weight may be recalled to encourage delightful experiences. Alternatively or additionally, memorable events with negative emotional weight may be recalled to increase user engagement for conversational systems.

Memorable event detection, recording, and exploitation

Systems and methods for automated mathematical chatting. The systems and methods convert any identified non-numerical inputs into vectors and then perform the mathematical equation utilizing the vectors instead of the nonnumeric inputs along with any other identified numeric inputs to obtain a numerical vector result. The systems and methods decode the numerical vector result into a result feature and then search one or more databases for output based on the result feature. The systems and methods provide the selected output from the one or more databases in response to the mathematical query.

Systems and methods for a mathematical chat bot

Systems and methods are disclosed for response retrieval using communication session vectors. In one implementation, a first communication session is received. The first communication session includes a first communication. The first communication session is encoded as a first vector. A second vector is identified within a defined proximity of the first vector. The second vector represents a second communication session that includes a second communication. The second communication is provided within the first communication session in response to the first communication.

Response retrieval using communication session vectors

Representative embodiments disclose mechanisms for discovering, synthesizing, presenting and interacting with multiple chat bots. A broker system can interact with a user and receive a query which is passed to a search engine. The search results are evaluated for bots provided by domains. The query can be submitted to the discovered bots. For domains that do not provide a bot, a bot can be synthesized if desired and the query submitted to the synthesized bots. Answers from the bots are retrieved. Answer are directly presented for bots that are directly surfaced to the user in the search results page. Answers can be fused for bots that are not directly surfaced to the user and presented via a broker bot. Answers from the one bot can be fed to other bots so that the bots can participate in a group chat between bots and the user.

Conversation bot discovery and response fusion

Examples of the present disclosure describe systems and methods relating to conversational system user experience. In an example, a conversational system may use one or more sensors of a user device to affect the topic or direction of a conversation or to identify a new conversation topic. The conversational system may also receive input from a user, wherein a GUI may enable the user to specify or alter semantic information used during the conversation. The GUI may comprise one or more skeuomorphic elements designed to provide a familiar or intuitive way for the user to interact with the conversational system. The GUI may also be used to disambiguate messages or convey emotion or sentiment to the user. In another example, haptic or audio feedback may be provided alongside a message to convey emotion to the user during the conversation.

Conversational system user experience

Systems and methods for personality consistent automated chatting are provided. The systems and methods track the emotional state of the chat bot, track entity related dispositions of the chat bot and/or track the closeness of the relationship between the chat bot and a user. Accordingly, the systems and methods are able to provide consistent personality and/or points of view by generating replies based on the tracked chat bot emotional state, chat bot entity dispositions, and/or the relationship closeness between the chat bot and the user.

Systems and methods for a personality consistent chat bot

Identifying a location of a mobile device is disclosed (e.g., presuming user consent to the same). One or more received signal strengths (RSSs), comprising a first RSS, may be received by a first access point (AP) from the mobile device. The RSSs may be used to identify a grid area, comprising a first grid space. A signal distance between the first grid space and the first AP may be identified using the first RSS, and combined with a first grid space distance, comprising a known distance between the first grid space and the first AP, to determine a first grid space likelihood score for the first grid space. A second grid space likelihood score may be determined for a second grid space (e.g., and a third, etc.), and the grid space comprising a desired grid space likelihood score (e.g., highest) may be selected as the mobile device location.

Locating a mobile device

One or more techniques and/or systems are disclosed for identifying a location of a mobile device (e.g., with user consent). A set of one or more indications of received signal strength (RSS) may be received, comprising a first RSS from a first access point (AP). The set of RSS indications may be used to identify a grid area, comprising a first grid space. An expected distance between the first grid space and the first AP may be identified using the first RSS. The expected distance can be combined with a first known distance between the first grid space and the first AP to determine a first grid score for the first grid space. A second grid score may be determined for a second grid space (e.g., and a third, fourth, etc.), and the grid space comprising a desired grid score (e.g., highest) may be selected as the mobile device location.

Among other things, one or more techniques and/or systems are disclosed for identifying a proximate beacon to a mobile device. One or more first received signal strengths (RSSs), relative to the mobile device, may be received and used to determine a first average signal strength (RSS) and a first average RSS deviation for a first beacon during an observation period. An average RSS deviation for the observation period can be determined using the first average RSS deviation (e.g., and other average RSS deviations). If the average RSS deviation meets a desired deviation threshold, the first beacon may be identified as the proximate beacon. In this manner, if the user of the mobile device consents to the same, the user may be provided with relevant information (e.g., advertisements) on the mobile device while in a locale (e.g., store) corresponding to the (known) location of the beacon, for example.

Growing community of inventors

Redmond, WA, United States of America

Hailong Mu