Microsoft Technology Licensing, LLC

Cheyne Rory Quin Mathey-Owens

Cameron Graeme Brown

Andrew Austin Jackson

Arthur Charles Tomlin

Michael Robert Thomas

Marcus Philip Ghaly

Jeff D Smith

Adam G Poulos

Aaron Daniel Krauss

Michael Scavezze

Charlene Mary Jeune

Jeffrey David Smith

Richard Wifall

Andrei Andreevich Borodin

Megan Ann Lindsay

Jonathan Gill

Adam Gabriel Poulos

Michael Thomas

A user may select or interact with objects in a scene using gaze tracking and movement tracking. In some examples, the scene may comprise a virtual reality scene or a mixed reality scene. A user may move an input object in an environment and be facing in a direction towards the movement of the input object. A computing device may use sensors to obtain movement data corresponding to the movement of the input object, and gaze tracking data including to a location of eyes of the user. One or more modules of the computing device may use the movement data and gaze tracking data to determine a three-dimensional selection space in the scene. In some examples, objects included in the three-dimensional selection space may be selected or otherwise interacted with.

Selection of objects in three-dimensional space

Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Displaying three-dimensional virtual objects based on field of view

Examples are disclosed herein that relate to the display of mixed reality imagery. One example provides a mixed reality computing device comprising an image sensor, a display device, a storage device comprising instructions, and a processor. The instructions are executable to receive an image of a physical environment, store the image, render a three-dimensional virtual model, form a mixed reality thumbnail image by compositing a view of the three-dimensional virtual model and the image, and display the mixed reality thumbnail image. The instructions are further executable to receive a user input updating the three-dimensional virtual model, render the updated three-dimensional virtual model, update the mixed reality thumbnail image by compositing a view of the updated three-dimensional virtual model and the image of the physical environment, and display the mixed reality thumbnail image including the updated three-dimensional virtual model composited with the image of the physical environment.

Updating mixed reality thumbnails

Motion and/or rotation of an input mechanism can be tracked and/or analyzed to determine limits on a user's range of motion and/or a user's range of rotation in three-dimensional space. The user's range of motion and/or the user's range of rotation in three-dimensional space may be limited by a personal restriction for the user (e.g., a broken arm). The user's range of motion and/or the user's range of rotation in three-dimensional space may additionally or alternatively be limited by an environmental restriction (e.g., a physical object in a room). Accordingly, the techniques described herein can take steps to accommodate the personal restriction and/or the environmental restriction thereby optimizing user interactions involving the input mechanism and a virtual object.

Interaction with virtual objects based on determined restrictions

Techniques described herein dynamically adapt an amount of smoothing that is applied to signals of a device (e.g., positions and/or orientations of an input mechanism, positions and/or orientations of an output mechanism) based on a determined distance between an object and the device, or based on a determined distance between the object and another device (e.g., a head-mounted device). The object can comprise one of a virtual object presented on a display of the head-mounted device or a real-world object within a view of the user. The object can be considered a 'target' object based on a determination that a user is focusing on, or targeting, the object. For example, the head-mounted device or other devices can sense data associated with an eye gaze of a user and can determine, based on the sensed data, that the user is looking at the target object.

Adaptive smoothing based on user focus on a target object

Growing community of inventors

Seattle, WA, United States of America

Cheyne Rory Quin Mathey-Owens