Microsoft Technology Licensing, LLC

Edward Sean Lloyd Rintel

Anthony Arnold Wieser

Eyal Ofek

John C Tang

Sasa Junuzovic

Abigail Jane Sellen

William Arthur Stewart Buxton

Kenton Paul Anthony O'Hara

Andrew David Wilson

Kenneth Paul Hinckley

Jason Thomas Faulkner

Michel Pahud

Jaron Zepel Lanier

Kevin D Morrison

Dominic Roedel

Ewin Davis Kannuthottiyil

Advait Sarkar

Mar Gonzalez Franco

Kori M Inkpen

Kenton O'Hara

Philipp Steinacher

Molly Jane Nicholas

Camilla Alice Longden

Martin Grayson

Payod Panda

Robert Corish

Ding Wang

Shu Sam Chen

Jens Emil Krarup Gronbaek

Eric Randall Sexauer

Matthew Alastair Johnson

Thaddeus Adam Scott

Daniel Wilkinson Gratiot

Philip Charles Gosset

Neil Dalchau

Ian James Ray

Richard Harry Robert Harper

Prashant Vaidyanathan

Kunal Gupta

Andriana Boudouraki

Lev Tankelevitch

Ozumcan Demir Caliskan

Bo Kang

A computer-implemented method of generating a mixed reality workflow is described. The method comprises identifying a series of tasks and generating an input task-to-object-mapping by analyzing data that defines a process performed by a first user interacting with objects in a first location. The input task-to-object-mapping that maps each task from the series of tasks to an object used in the respective task. A task-specific non-spatial characteristic of each object in the input task-to-object-mapping is determined and used to map each object in the input task-to-object-mapping to a candidate object identified at a second location to generate an output task-to-object-mapping. The series of tasks, location data defining a position of each candidate object in the second location and output task-to-object-mapping are used to generate a mapped workflow which is then output to a device in the second location.

Mixed reality workflow generation

A computer-implemented method is described which comprises generating a representation of a digital space and a representation of the physical space using an audiovisual feed received from a camera proximate to a display located in the physical space. The representation of the digital space is generated using user information identifying a remote user associated with the display and presence information relating to the remote user and the digital representation comprises an avatar of the remote user. The representation of the digital space is output to the display located in the physical space and the representation of the physical space it output to a computing device associated with the remote user. The method further comprises dynamically updating the representation of the digital space and/or physical space in response to changes in the user information and presence information.

Collaborative system

Aspects of this present disclosure relate to hybrid conference user interface. The hybrid conference interface provides an establishing shot before the meeting begins that places meeting attendees in a specific spatial arrangement, such as in specific seats around a conference table. Upon starting the conference, the hybrid user interface renders an appropriate perspective view of the meeting that is tailored to each attendee's perspective while also being spatially consistent for the entire group of attendees. Allowing attendees to place themselves where they want gives attendees a sense of physical space that helps them stay spatially oriented relative to the other people and resources in the room.

Established perspective user interface and user experience for video meetings

A method of providing a geographically distributed live mixed-reality meeting is described. The method comprises receiving, from a camera at a first endpoint, a live video stream; generating an mixed reality view incorporating the received video stream; rendering the mixed reality view at a display at the first endpoint and transmitting the mixed reality view to at least one other geographically distant endpoint; receiving data defining a bounding area; calculating a real world anchor for the bounding area using the data defining the bounding area; rendering the bounding area in the mixed reality view at a real world position determined using the real world anchor; and applying different rule sets to content objects placed into the mixed reality view by users dependent upon the position of the content objects relative to the bounding area in real world space.

Multi-endpoint mixed-reality meetings

Aspects of the present disclosure relate to headset virtual presence techniques. For example, a participant of a communication session may not have an associated video feed, for example as a result of a user preference to disable video communication or a lack of appropriate hardware. Accordingly, a virtual presence may be generated for such a non-video participant, such that the non-video participant may be represented within the communication session similar to video participants. The virtual presence may be controllable using a headset device, for example such that movements identified by the headset device cause the virtual presence to move. In some instances, user input may be received to control emotions conveyed by the virtual presence, for example specifying an emotion type and/or intensity.

Headset virtual presence

Aspects of the present disclosure relate to computing device headset input. In examples, sensor data from one or more sensors of a headset device are processed to identify implicit and/or explicit user input. A context may be determined for the user input, which may be used to process the identified input and generate an action that affects the behavior of a computing device accordingly. As a result, the headset device is usable to control one or more computing devices. As compared to other wearable devices, headset devices may be more prevalent and may therefore enable more convenient and more intuitive user input beyond merely providing audio output.

Computing device headset input

Multi-endpoint mixfd-reality meetings

The present disclosure provides a number of techniques for enhancing a user's experience when joining teleconference sessions with multiple devices. When a user attempts to join a teleconference session using the same user identity for multiple devices, a system differentiates the devices as a primary device and at least one companion device. The primary device has a first control set for controlling a teleconference session and the at least one companion device has a companion control set for sharing content. In some embodiments, the primary device also has one set of selected streams, e.g., a stage view, and the companion device has a subset of those streams or other streams based on an activity level. In addition, the present disclosure provides a number of techniques for enabling users to share content using the companion devices.

Companion devices for real-time collaboration in communication sessions

The present disclosure provides a number of techniques for enhancing a user's experience when joining teleconference sessions. When multiple users join a teleconference session using separate devices, a system identifies devices that are co-located. The co-located devices are identified by the use of a combination of data including, but not limited to social signals, audio signal and other location data. At least one device of the co-located devices, has a first control set for controlling a teleconference session and other devices of the co-located devices have a second control set for sharing content. The at least one device also has one set of streams and the other devices see a subset of those streams or other streams based on an activity level. In addition, the present disclosure provides a number of techniques for enabling users to use multiple devices to share content.

Enhanced techniques for joining communication sessions

A projection unit has a rotating capture module and a rotating projection module. The capture module has at least one color camera, at least one microphone and at least one depth camera and is configured to capture images of an environment. The rotating projection module is configured to project images onto at least one surface in the environment. The projection unit has a processor configured to use data captured by the rotating capture module to select the at least one surface in the environment, the selection being dependent on a field of view of at least one user in the environment and dependent on characteristics of surfaces in the environment. The processor is configured to control rotation of the rotating capture module such that the data captured by the rotating capture module is suitable for computing field of view the user, and for determining characteristics of the surfaces.

Projection unit

A telecommunications device sends and receives messages comprising data about telecommunications resources and resource state of proximate devices. The telecommunications device has a processor configured to determine a proximate resource pool using at least the telecommunication resources of the other devices, and the state of the telecommunications resources of the other devices, the proximate resource pool comprising a list of content streams being generated by, or potentially being generated by, specified ones of the other devices. The processor is configured to receive instructions from one of the other devices, the instructions being to add, divert or stop a specified content stream of the proximate resource pool within a telecommunications activity ongoing at the device. In various examples, the processor is configured to execute the instructions responsive to the instructions being from a trusted device, or responsive to user authorization.

Proximate resource pooling in video/audio telecommunications

Growing community of inventors

Cambridge, United Kingdom

Edward Sean Lloyd Rintel