Microsoft Technology Licensing, LLC

Elwha LLC

Graphics Properties Holdings, Inc.

Eyematic Interfaces, Inc.

Jaron Zepel Lanier

Steven Nabil Bathiche

Lowell L Wood, Jr

Roderick A Hyde

Clarence T Tegreene

Edward K Y Jung

Jordin T Kare

Charles Whitmer

William Henry Gates, Iii

Alistair K Chan

John L Manferdelli

Joel Steven Kollin

Victoria Y H Wood

David Bazeley Tuckerman

Douglas Christopher Burger

Muriel Y Ishikawa

Kenneth Paul Hinckley

Eyal Ofek

William David Duncan

Karin Strauss

Michel Pahud

Edward Sean Lloyd Rintel

Mar Gonzalez Franco

Molly Jane Nicholas

Payod Panda

Andrew Maimone

Brett David Brewer

Adrian Travis

Doug Burger

Johnny Chung Lee

Oriana Riva

Nikunj Raghuvanshi

Agustya Ruchir Mehta

Ran Gal

Kurt Akeley

Judith Amores Fernandez

Joseph Menke

Viktor A Mateevitsi

Josh Hudman

Andrzej Banburski

Kishore Rathinavel

Wayne Chang

Javier Arturo Porras Luraschi

Gheric Speiginer

Scott Lerner

Andreas Georgiou

The techniques disclosed herein provide controlled user interface transitions for private breakout communication sessions. A system provides a Together Mode user interface that gives participants of a communication session a feeling that they are in the same room. When a person joins a communication session, a system uses a seating policy to determine a location of that user. That user is placed near or next to a select user. A policy is applied when users meet one or more conditions. If a number of people join the communication session, each person is ranked according to an organizational chart and each person is positioned and ordered relative to the select user according to each person's rank. The system configures the updated user interface arrangement to maintain the position of the select group of the participants.

Controlled user interface transitions using seating policies that position users added to communication sessions

The techniques disclosed herein provide controlled user interface transitions for private breakout communication sessions. A system provides a Together Mode user interface that gives participants of a communication session a feeling that they are in the same room. When a person joins a communication session, a system uses a seating policy to determine a location of that user. That user is placed near or next to a select user meeting one or more conditions. If a number of people join the communication session, each person is ranked according to an organizational chart and each person is positioned and ordered relative to the select user according to each person's rank. The system configures the updated user interface arrangement to maintain the position of the select group of the participants.

Controlled user interface transitions using seating policies that rank users added to communication sessions

Aspects of the present disclosure relate to headset virtual presence techniques. For example, a participant of a communication session may not have an associated video feed, for example as a result of a user preference to disable video communication or a lack of appropriate hardware. Accordingly, a virtual presence may be generated for such a non-video participant, such that the non-video participant may be represented within the communication session similar to video participants. The virtual presence may be controllable using a headset device, for example such that movements identified by the headset device cause the virtual presence to move. In some instances, user input may be received to control emotions conveyed by the virtual presence, for example specifying an emotion type and/or intensity.

Headset virtual presence

Aspects of the present disclosure relate to computing device headset input. In examples, sensor data from one or more sensors of a headset device are processed to identify implicit and/or explicit user input. A context may be determined for the user input, which may be used to process the identified input and generate an action that affects the behavior of a computing device accordingly. As a result, the headset device is usable to control one or more computing devices. As compared to other wearable devices, headset devices may be more prevalent and may therefore enable more convenient and more intuitive user input beyond merely providing audio output.

Computing device headset input

The present disclosure provides systems that display visual indicators that provide user awareness of independent activity of participants in a communication session. The visual indicators are displayed within a Together Mode user interface that gives participants of a communication session a feeling that they are in the same room. The visual indicators further the technical benefits of the Together Mode user interface by providing additional context to particular non-verbal social cues. A system can generate a visual indicator that notifies meeting participants that a particular user is engaged with a computing device. The visual indicator can be generated in response to detecting that the user is interacting with an input device, such as a keyboard or touchscreen. The visual indicator mitigates confusion of non-verbal social cues, e.g., when a person appears to be looking at another participant of a meeting but is actually looking at, and interacting with, a computer.

Visual indicators for providing user awareness of independent activity of participants of a communication session

Systems that execute controlled user interface transitions for private breakout communication sessions are described herein. A system provides a user interface that gives participants of a communication session a feeling that they are in the same room. When a select group of the participants break out into a private communication session, the system can transition from a first user interface arrangement showing all meeting participants to a second user interface arrangement that only shows the select group of the participants. The system configures the second user interface arrangement to maintain the position of the select group of the participants while removing the participants who are not selected to participate in the private communication session. By maintaining the position of the participants of the private communication session, the system can help participants to maintain a cognitive stream of nonverbal social cues that were provided in the original user interface arrangement.

Controlled user interface transitions for private breakout communication sessions

Described herein is a multi-view display (based on spatial and/or temporal multiplexing) having an optimization mechanism that dynamically adjust views based upon detected state changes with respect to one or more views. The optimization mechanism determines viewing parameters (e.g., brightness and/or colors) for a view based upon a current position of the view, and/or on the multi-view display's capabilities. The state change may correspond to the view (a viewer's eye) moving towards another viewing zone, in which event new viewing parameters are determined, which may be in anticipation of entering the zone. Another state change corresponds to more views being needed than the display is capable of outputting, whereby one or more existing views are degraded, e.g., from 3D to 2D and/or from a personal video to a non-personal view. Conversely, a state change corresponding to excess capacity becoming available can result in enhancing a view to 3D and/or personal.

Optimization of a multi-view display

The discussion relates to spatially meshed interactive devices. One example can include a mesh component that has access to a layout of features of a facility and to information about users associated with the facility. The example can also include multiple interactive devices including sensors and communication components. The multiple interactive devices are communicatively coupled via the communication components and at least some of the multiple interactive devices are communicatively coupled to the mesh component. The multiple interactive devices are located at known positions in the facility to create a spatial mesh at the facility relative to the features.

Coupled interactive devices

Techniques described herein include mixed reality tools, referred to as HoloPaint, that allow use of any of a variety of sensors to determine physical parameters of real objects in a mixed reality environment. HoloPaint may correlate current measurements of the real world with past measurements to perform inventory management, analysis of changes of physical parameters of real objects and environments, and so on. A user may select which parameter to analyze by selecting a particular type of virtual paint, such as for drawing onto an object to be analyzed.

Attribute detection tools for mixed reality

A multi-optical surface optical design for generating multiple focal planes with identical image data displayed at substantially the same time to generate the perception of varying focal depths is described. The multi-optical surface optical design can include a device comprising reflective optical surfaces that can be arranged on top of one another and configured to generate multiple focal planes and an image source for projecting image data onto the reflective optical surfaces. The technologies described can cause image data to be rendered in a focal plane corresponding to a desired focal distance and multiple copies of the image can be perceived in other focal planes of the multiple focal planes at substantially the same time as the image data is rendered in the focal plane. Each copy of the multiple copies can be presented with a perceived degree of sharpness such that each copy is out-of-focus.

Multi-optical surface optical design

Techniques described herein include graphically representing mathematical functions or operators in a mixed or virtual reality display device. The graphical representations may be moved around in a virtual reality space that includes displayed source material, such as data. If the graphical representations are located along a line of sight from a virtual location of a user of the mixed or virtual reality display device to the displayed source data, then the mathematical functions or operators represented by the graphical representations are applied to the displayed source data. Results may be displayed on the graphical representation virtually located closest to the virtual location of the user. Techniques described herein allow for simultaneous collaboration among mixed or virtual reality display devices of multiple users interacting with the graphical representations in the virtual reality space.

Math operations in mixed or virtual reality

A method of displaying visual information to different viewer-eyes includes receiving eye strength data indicative of a deficiency of a weak viewer-eye with respect to a dominant viewer-eye. The method further includes causing a 3D-display system to display a first perspective of an image to the weak viewer-eye and causing the 3D-display system to display a second perspective of the image to the dominant viewer-eye. A difference between the first perspective and the second perspective is a variation of a display characteristic of one of the first and second perspectives where the variation is made in accordance with the indicated deficiency of the weak viewer-eye.

Systems and methods for differentiating between dominant and weak eyes in 3D display technology

Embodiments are disclosed for a display system having multiple fields of view. An example display system comprises a first display configured to produce images across a first field of view, a second display configured to produce images across a second field of view, the second field of view being larger than the first field of view, and a controller configured to selectively present a virtual object via one or more of the first display and the second display based on a feature of the virtual object as displayed within a user's viewspace.

Hybrid display system

The techniques describe herein use sensor(s) to scan a real-world environment and obtain data associated with geometry of the real-world environment that affects how energy propagates (e.g., locations of spatial objects in a room). The sensor(s) also detect energy (e.g., sound) in the real-world environment, from which a location of a source of the energy can be determined. The techniques combine the geometry data and the energy data to determine how the detected energy propagates from the location of the source through the real-world environment. The techniques can then cause a representation of the propagating energy to be displayed, to a user, as virtual content via a mixed reality device. Accordingly, a user is able to see energy that is otherwise invisible.

Virtually visualizing energy

Growing community of inventors

Sausalito, CA, United States of America

Jaron Zepel Lanier