Microsoft Technology Licensing, LLC

Michel Pahud

Kenneth Paul Hinckley

Eyal Ofek

Nathalie Henry Riche

Christophe Hurter

William A S Buxton

William Arthur Stewart Buxton

Jin Li

Rajesh Hegde

Zhengyou Zhang

Hrvoje Benko

Pourang Polad Irani

Steven Mark Drucker

Sasa Junuzovic

Ken Hinckley

Kori Marie Quinn

Molly Jane Nicholas

Andrew David Wilson

Michael Jack Sinclair

Christian F Huitema

Zicheng Liu

Francois Guimbretiere

William Buxton

Margaret K Johnson

Sharon Kay Cunnington

Heinz Wilfried Schuller

Howard William Phillips, Ii

Jonathan David Goldstein

Jaron Zepel Lanier

Koji Yatani

Adam Samuel Riddle

Mar Gonzalez Franco

Edward Sean Lloyd Rintel

Richard Lloyd Hughes

Haijun Xia

Pierre P N Greborio

Nicolai Marquardt

Chunjong Park

Frederik Martin Brudy

Irina Spiridonova

Jonathan E Paff

Wenqi Shen

Hugo Karl Denis Romat

Christopher Mervin Collins

Payod Panda

Nathalie Maryline Riche

Xuedong D Huang

Philip Andrew Chou

Oscar E Murillo

Johnson T Apacible

Gina Danielle Venolia

Amy Kathleen Karlson

Jay Beavers

Dinei Afonso Ferreira Florencio

Benjamin B Bederson

John E Paff

Jatin Sharma

Yoichi Ochiai

Seongkook Heo

Takako Aikawa

David William Brown

James E Oker

Hrovje Benko

Ken Pfeuffer

Andrew M Webb

Zhengyon Zhang

Jayman Dalal

Lee A Schwartz

Systems and methods relate to sharing content and data across users and devices. A shared folios include media primitives and tools as its constituents. The use of shared folios addresses an issue of reliably and efficiently transfer user activities with data. The use addresses scenarios of both single-user work utilizing multiple devices and collaborative work among users utilizing multiple devices. The media primitive includes content in various data types. The tool include data and access to the data by devices and applications. A data distributor manages automatic synchronization of the folios across devices using centralized and distributed transaction logs The folios are synchronized with resiliency against failure in client devices. The folio and its constituents are interactively accessible through top-level, semi-transparent user interface. The media primitive and the tools may programmatically access local applications to automatically transfer user activities among users and devices.

Method for sharing content and tools independently from devices, applications, users and times

Aspects of the present disclosure relate to multi-user, multi-device gaze tracking. In examples, a system includes at least one processor, and memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations. The set of operations include identifying a plurality of computing devices, and identifying one or more users. The set of operations may further include receiving gaze input data and load data, from two or more of the plurality of computing devices. The set of operations may further include performing load balancing between the plurality of devices, wherein the load balancing comprises assigning one or more tasks from a first of the plurality of computing devices to a second of the plurality of computing devices based upon the gaze input data.

Multi-device gaze tracking

Methods and systems are disclosed for sharing a content item from a secondary computing device to a primary computing device based on a tilt position of the secondary computing device. A sensor on the secondary computing device determines that the secondary computing device has a first tilt position that is associated with a non-sharing mode. The sensor senses that the secondary computing device is tilting from the first tilt position towards a second tilt position that is associated with a full sharing mode. In response, the content item is shared with the primary computing device. An amount of the content item that is shared continues to be increased as long as the sensor continues to sense that the secondary computing device is tilting. Once the secondary computing device has reached the second tilt position, the entire content item is shared with the primary computing device.

Tilt-responsive techniques for sharing content

Methods and systems for rendering augmented reality display data to locations of a physical presentation environment based on a presentation configuration are provided. A physical presentation environment configuration may be accessed that includes locations of a physical presentation environment for mapping augmented reality display data. The augmented reality display data may include a plurality of augmented reality objects that are rendered for display. Presentation attributes of the augmented reality display data may be used in conjunction with the presentation configuration for mapping and rendering the augmented reality display data. The rendered augmented reality display data may be dynamically interactive, and may be generated based on previous presentation configurations, mapping preferences, mapping limitations, and/or other factors.

Presenting augmented reality display data in physical presentation environments

In some examples, a surface, such as a desktop, in front or around a portable electronic device may be used as a relatively large surface for interacting with the portable electronic device, which typically has a small display screen. A user may write or draw on the surface using any object such as a finger, pen, or stylus. The surface may also be used to simulate a partial or full size keyboard. The use of a camera to sense the three-dimensional (3D) location or motion of the object may enable use of above-the-surface gestures, entry of directionality, and capture of real objects into a document being processed or stored by the electronic device. One or more objects may be used to manipulate elements displayed by the portable electronic device.

Three-dimensional object tracking to augment display area

Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode, and may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface may be associated with a second use mode.

Tilt-responsive techniques for digital drawing boards

Aspects of the present disclosure relate to headset virtual presence techniques. For example, a participant of a communication session may not have an associated video feed, for example as a result of a user preference to disable video communication or a lack of appropriate hardware. Accordingly, a virtual presence may be generated for such a non-video participant, such that the non-video participant may be represented within the communication session similar to video participants. The virtual presence may be controllable using a headset device, for example such that movements identified by the headset device cause the virtual presence to move. In some instances, user input may be received to control emotions conveyed by the virtual presence, for example specifying an emotion type and/or intensity.

Headset virtual presence

Various systems and techniques for intuitively and non-obstructively obtaining awareness of fellow collaborator views and/or statuses in an augmented reality environment are disclosed. An interaction is detected between a first and second HMD, both collaborative participants of a shared dataset represented in an augmented reality environment. The detected interaction can cause the first HMD to request state information associated with the second HMD. The second HMD can process the request in accordance with a privacy policy to generate a set of visual data as a response to the request. The second HMD can communicate the generated set of visual data to the first HMD, such that the first HMD can render the received set of visual data as additional computer-generated object(s) to be displayed concurrently with its own augmented view. The additional computer-generated object(s) can be positioned in accordance with a real-world or virtualized position of the second HMD, such that the now-visible state information associated with the second HMD does not obstruct a view of the second HMD's user.

Intuitive augmented reality collaboration on visual data

The description relates to cooperatively controlling devices based upon their location and pose. One example can receive first sensor data associated with a first device and second sensor data associated with a second device. This example can analyze the first sensor data and the second sensor data to determine relative locations and poses of the first device relative to the second device and can supply the locations and poses to enable content to be collectively presented across the devices based upon the relative locations and poses.

Multiple device content management

Aspects of the present disclosure relate to computing device headset input. In examples, sensor data from one or more sensors of a headset device are processed to identify implicit and/or explicit user input. A context may be determined for the user input, which may be used to process the identified input and generate an action that affects the behavior of a computing device accordingly. As a result, the headset device is usable to control one or more computing devices. As compared to other wearable devices, headset devices may be more prevalent and may therefore enable more convenient and more intuitive user input beyond merely providing audio output.

Computing device headset input

Methods and systems are disclosed for sharing a content item from a secondary computing device to a primary computing device based on a tilt position of the secondary computing device. A sensor on the secondary computing device determines that the secondary computing device has a first tilt position that is associated with a non-sharing mode. The sensor senses that the secondary computing device is tilting from the first tilt position towards a second tilt position that is associated with a full sharing mode. In response, the content item is begun to be shared with the primary computing device. An amount of the content item that is shared with the primary computing device is continued to be increased as long as the sensor continues to sense that the secondary computing device is tilting from the first tilt position towards the second tilt position. The sensor senses that the secondary computing device has reached the second tilt position and shares the entire content item with the primary computing device.

In various embodiments, methods and systems for implementing a multi-device mixed interactivity system are provided. The interactivity system includes paired mixed-input devices for interacting and controlling virtual objects. In operation, a selection profile associated with a virtual object is accessed. The selection profile is generated based on a selection input determined using real input associated with a selection device and virtual input associated with a mixed-reality device. The selection device has a first display and the mixed-reality device has a second display that both display the virtual object. An annotation input for the virtual object based on a selected portion corresponding to the selection profile is received. An annotation profile based on the annotation input is generated. The annotation profile includes annotation profile attributes for annotating a portion of the virtual object. An annotation of the selected portion of the virtual reality object is caused to be displayed.

Annotation using a multi-device mixed interactivity system

Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode. The first user interface may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface has different functionality than the first user interface. The second user interface may be associated with a second use mode that is different than the first use mode but may be based on the same application as the first user interface.

Method for sharing content and tools independently from devices, applications, users, and times

Growing community of inventors

Kirkland, WA, United States of America

Michel Pahud