Microsoft Technology Licensing, LLC

Adi Diamant

Karen Master Ben-Dor

Eyal Krupka

Kfir Karmon

Oded Elyada

Raz Halaly

Xuedong D Huang

Inbal Ort Bengal

Lili Cheng

Wei Xiong

Thomas Matthew Laird-McConnell

Amit Kumar Agarwal

Lijuan Qin

Xiong Xiao

Sonja Sabina Knoll

Shixiong Zhang

Guy Asi Merin

Ido Leichter

Yoni Smolin

Lingfeng Wu

Moshe David

Aviv Hurvitz

Ilya Gurvich

Zijia Zheng

Karen Rachel Master Ben-Dor

Daniel Dos Santos Marques

Shunfu Mao

Jeffrey M Jo

Shaiket S Das

Aditya R Kalro

Karen Master Ben-dor

Ami Luttwak

Alok Kumar Srivastava

Adi L Miller

Nir Levy

Irit Kantor

Avigad Oron

Eyal Livne

Moaid Hathot

Eli Arbel

Roni Karassik

Avner Shahar-Kashtan

Rotem Bennet

Alexander Vakaluk

Eli Schwartz

Alexander Pshul

Michael Andrew Foynes

Eli Ben-David

Merav Davidson

Rona Mayk

Ariel Ben-Horesh

Noga Amit-Miller

Eshchar Zychlinski

Eliazer Carmon

The disclosure herein describes providing responses to natural language queries associated with transcripts at least by searching multiple indexes. A transcript associated with a communication among a plurality of speakers is obtained, wherein sets of artifact sections are identified in the transcript. A set of section indexes is generated from the transcript based on artifact type definitions. A natural language query associated with the transcript is analyzed using a natural language model and query metadata of the analyzed natural language query is obtained. At least one section index of the set of section indexes is selected based on the obtained query metadata and that selected at least one section index is searched. A response to the natural language query is provided including result data from the searched at least one search index, wherein the result data includes a reference to an artifact section referenced by the searched section index(es).

Providing responses to queries of transcripts using multiple indexes

A method for facilitating a remote conference includes receiving a digital video and a computer-readable audio signal. A face recognition machine is operated to recognize a face of a first conference participant in the digital video, and a speech recognition machine is operated to translate the computer-readable audio signal into a first text. An attribution machine attributes the text to the first conference participant. A second computer-readable audio signal is processed similarly, to obtain a second text attributed to a second conference participant. A transcription machine automatically creates a transcript including the first text attributed to the first conference participant and the second text attributed to the second conference participant.

Computerized intelligent assistant for conferences

The disclosure herein describes providing responses to natural language queries associated with transcripts at least by searching multiple indexes. A transcript associated with a communication among a plurality of speakers is obtained, wherein sets of artifact sections are identified in the transcript. A set of section indexes is generated from the transcript based on artifact type definitions. A natural language query associated with the transcript is analyzed using a natural language model and query metadata of the analyzed natural language query is obtained. At least one section index of the set of section indexes is selected based on the obtained query metadata and that selected section index is searched. A response to the natural language query is provided including result data from the searched at least one search index, wherein the result data includes a reference to an artifact section referenced by the searched section index(es).

Automatically alternating between input modes on a computing device based on a usage pattern is provided. A first input mode is initiated for interacting with content displayed on the computing device. An input corresponding to a second input mode on the computing is then detected. A transition is then made from the first input mode to the second input mode on the computing device. Upon the detecting a termination of the input on the displayed content the second input mode, a gradual transition is made from the second input mode to the first input mode based on a current sensor state of the computing device and a threshold.

Accommodating sensors and touch in a unified experience

Computer interfaces are provided for accessing and displaying content from disparate and remotely connected computer systems and that can be used for facilitating collaboration and visualization of physical and cloud resources for distributed event management. Systems are provided for generating, modifying, deploying, accessing, and otherwise managing the computer interfaces. Templates are used to build canvas interfaces that are contextually relevant for different entities based on the context of associated events and assigned roles of the entities with respect to the different events. The canvas interfaces can be used to access and orchestrate resources associated with the different events.

In-context event orchestration of physical and cyber resources

In non-limiting examples of the present disclosure, systems, methods and devices for executing a command by a digital assistant in a group device environment are presented. A plurality of devices with digital assistants may be clustered for the duration of an event. One of the devices of the cluster may be assigned as an arbitrator device for the cluster. A user may issue a verbal command executable by a digital assistant of the cluster. The user that issued the verbal command may be identified via voice analysis. A determination may be made as to whether the verbal command corresponds to an intent to share content with a plurality of members of the cluster, or a specific member of the cluster, and a device of the cluster may be selected for executing a reply to the verbal command based on the determined intent and the executing device's presentation capabilities.

Identification and processing of commands by digital assistants in group device environments

An apparatus including a housing for coupling a keyboard to a tablet device through at least one respective electric interface and circuitry integrated in the housing, and a camera sensor integrated in the housing, the camera sensor positioned such that a central axis of a field of view (FOV) of the camera sensor is substantially parallel to a surface of the keyboard, the camera sensor further positioned to capture a plurality of images and to transmit the plurality of images to the tablet device through the respective electric interface and the electric circuitry. Related apparatus and methods are also described.

Accessory between display and keyboard

Hand gesture detection electrical device for detecting hand gestures, comprising an IC electronically integrating:

Electrical device for hand gestures detection

A system of injecting a code section to a code edited by a graphical user interface (GUI) of an integrated development environment (IDE), comprising: a memory storing a dataset associating each code segment with one hand pose feature or hand motion feature; an imager adapted to capture images of a hand while an IDE being executed on a client terminal; and processor for executing code of an application, comprising: code instructions to identify at least one of the features and at least one discrete value of the identified features from an analysis of the images; code instructions to select at least one of the code segments associated with the identified features; and code instructions to add automatically a code section generated based on the code segments and the discrete value to a code presented by a code editor of the IDE.

Translation of gesture to gesture code description using depth camera

A system for associating between a computerized model of multimodal human interaction and application functions, comprising:

Multimodal interaction using a state machine and hand gestures discrete values

Controlling images at mobile devices using sensors is described, for example, for interactive advertisements which respond to sensor readings at a mobile computing device. In various embodiments images are displayed at a mobile computing device according to sensor readings observed at the device and before user input is received at the images. For example, different regions of an image depicting a panorama are displayed as a mobile device is panned around or tilted. In another example images of an object in different orientations are presented as a mobile device is tilted in order to display the object as rotating. In various examples the images are displayed as part of a web page by using a template in the web page to control the display of images according to sensor readings. In various examples sensor readings are used to report user engagement with advertisements.

Controlling images at mobile devices using sensors

A movie browsing system may use a combination of long term and session based preferences to help a user browse movies using microcategories. The user preferences may be stored as microcategory weights, where the session based weights may change during a session as the system learns the types of movies a user wishes to see at that time. The long term microcategory weights may change at a slower rate than the session weights. The system may present a diverse set of microcategories to a user in an effort to diverge the search and learn the user's current interest, and may refine the weights as the user browses to converge to a desired movie. A user interface may operate on a television screen with a minimum of user input controls to navigate the browsing system while still collecting user preferences.

Movie discovery system

Growing community of inventors

Shoham, Israel

Adi Diamant