Microsoft Technology Licensing, LLC

Amazon Technologies, Inc.

Brian James Mount

Daniel Joseph McCulloch

Stephen G Latta

Kevin Geisner

Arthur Charles Tomlin

Ryan Lucas Hastings

Jonathan Steed

Adam G Poulos

Jason Bradley Scott

Darren Bennett

Michael Scavezze

Anthony James Ambrus

Aaron Daniel Krauss

Ben J Sugden

Cameron Graeme Brown

Mike Scavezze

Michael H Thomas

Tony Ambrus

Dillon Taylor Baker

Hai Quang Kim

Joonhao Chuah

Kristian Kane

Wei Zhang

Ian Douglas McIntyre

Dan B Kroymann

Robert L Crocco, Jr

Kyungsuk David Lee

Gregory Alt

Evan Michael Keibler

Sebastian Sylvan

Jesse Alan DuPree

Kathryn Stone Perez

Shawn Crispin Wright

Alexandru Octavian Balan

Jeffrey Alan Kohler

Abby Lin Lee

Holly A Hirzel

Lee David Thompson

Phillip Charles Heckinger

Alex Aben-Athar Kipman

Mark James Finocchio

Jeffrey Neil Margolis

Mathew Julian Lamb

John Clavin

Justin Avram Clark

Nahil Tawfik Sharkasi

John Bevis

Daniel Lee Osborn

David C Haley, Jr

Roger Sebastian Sylvan

Albert Robles

Michael Jason Gourlay

Dave Hill

Roger Sebastian-Kevin Sylvan

Arnulfo Zepeda Navratil

Andrew R Campbell

Jea Gon Park

Andrew David Wilson

Rod G Fleck

Derek L Knee

Alex A Kipman

Benjamin Isaac Vaught

Drew Edward Steedly

Frederik Schaffalitzky

Nicholas Fajt

Aaron Burns

Gerhard A Schneider

Dan Osborn

Quentin Simon Charles Miller

Scott Robert Ramsby

David Robert Cole

Sheridan Martin Small

Britta Silke Hummel

Christopher Harley Willoughby

Jedd Perry

Jordan Dale Andersen

Lewey Geselowitz

Adam Benjamin Smith-Kipnis

Jonathan Lyons

Roger Sebastian Kevin Sylvan

Matthew Kaplan

Joon Hao Chuah

Erik Andrew Saltwell

Christopher Vuchetich

Mike Thomas

Mark Mihelich

Katelyn Doran

Ron Amador-Leon

Robert Crocco

Jack Clevenger

Vaibhav Goel

Will Guyman

Tim Psiaki

Abdulwajid N Mohamed

Cameron Quinn Egbert

Christopher Obeso

Jorge Tosar

Jeff W McGlynn

Jeremy Hance

Alexander Georg Pfaffe

Systems and methods related to user interfaces for object exploration and manipulation within virtual reality environments may include a plurality of user interfaces that are presented responsive to various user inputs or interactions. For example, a first user interface may comprise a hover card that is presented responsive to a hover indication over an object, a second user interface may comprise a detail card that is presented responsive to a selection input associated with an object, and a third user interface may comprise a detail page having a plurality of detail panels that are presented responsive to a selection of a full details option associated with an object. Further, individual detail cards and detail panels may be graspable, movable, scrollable, and otherwise manipulatable by a user to facilitate object exploration.

User interfaces for object exploration in virtual reality environments

Systems and methods related to user interfaces for virtual reality environments may include two-dimensional grid view user interfaces and three-dimensional side-by-side view user interfaces, and associated transitions therebetween. The two-dimensional grid view user interfaces may present images or models of a plurality of objects to users in a substantially flat, two-dimensional grid for viewing of objects. The three-dimensional side-by-side view user interfaces may present models of a plurality of objects to users in a substantially open, three-dimensional area for viewing and evaluation of three-dimensional models of objects.

User interfaces for browsing objects in virtual reality environments

Systems and methods related to an image capture process using panorama paths may include traversing a user device among a plurality of image capture locations of a room, sweeping the user device at each of the image capture locations, capturing imaging data using the user device during the traversal and/or during the sweep, and processing the imaging data using photogrammetry. The imaging data may be captured using an imaging sensor associated with the user device, and the imaging data may be processed based on data received from position and orientation sensors associated with the user device. In addition, a three-dimensional model of the room may be generated based on the imaging data.

Three-dimensional room model generation using panorama paths and photogrammetry

Systems and methods related to generating and modifying a room or space within a virtual reality environment may comprise addition, removal, placement, modification, and/or resizing of a plurality of environment surfaces, such as a floor, walls, and ceiling, and/or a plurality of fixtures, such as doors, windows, or openings, associated with the environment surfaces, in which each environment surface and fixture includes associated dimensions. The environment surfaces and fixtures may be added, removed, placed, moved, and/or resized by a user. During such interactions, only a subset of dimensions relevant to the current functions or operations by the user may be presented to facilitate such functions or operations. Further, various aspects associated with environment surfaces and fixtures may be modified, such as paints, colors, materials, textures, or others.

Generation and modification of rooms in virtual reality environments

Systems and methods related to an image capture process using ring paths may include traversing a user device around a ring path in a center of a room, capturing imaging data using the user device during the traversal, and processing the imaging data using photogrammetry. The imaging data may be captured using an imaging sensor associated with the user device, and the imaging data may be processed based on data received from position and orientation sensors associated with the user device. In addition, a three-dimensional model of the room may be generated based on the imaging data.

Three-dimensional room model generation using ring paths and photogrammetry

Systems and methods related to detecting characteristics of images and accentuating or manipulating characteristics of images are described. For example, a principal color of an image may be identified, a complement color may be determined based on the principal color, and the complement color may be applied to the image to accentuate the image. In this manner, an object of interest represented in the image may be emphasized and displayed in a more visually attractive manner. In addition, edges of an image may be evaluated to determine if one or more visibly cropped edges are present within the image, the image may be further cropped to remove the visibly cropped edges, and/or the image may be shifted or magnified based on such cropped edges. In this manner, an object of interest represented in the image may be magnified and emphasized, and visually distracting elements may be removed from the image.

Product image characteristic detection and manipulation

Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

Constructing augmented reality environment with pre-computed lighting

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

Space carving based on human physical data

Systems and methods related to augmented reality guidance for an image capture process using panorama paths may include presenting various text, cues, and indications to guide the image capture process. A user device including an imaging sensor and position and orientation sensors may present, via a display, the various text, cues, and indications during portions of the image capture process, including a plurality of image capture locations, imaging sensor sweep guides, textual instructions, arrows, and position guides.

Three-dimensional room model generation using panorama paths with augmented reality guidance

Systems and methods related to a room measurement process may include determining a floor plane associated with a room, determining a plurality of wall planes associated with the room, and determining a ceiling plane associated with the room. The room measurements may be based on data received from an imaging sensor and position and orientation sensors associated with a user device. In addition, a three-dimensional geometric shell of the room may be generated based on the room measurements.

Three-dimensional room measurement process

Systems and methods related to augmented reality guidance for a room measurement process may include presenting various text, cues, and indications to guide the room measurement process. A user device including an imaging sensor and position and orientation sensors may present, via a display, the various text, cues, and indications during portions of the room measurement process, including identification of the floor, walls, and ceiling.

Three-dimensional room measurement process with augmented reality guidance

Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Mixed reality interactions

A head-mounted display includes a see-through display and a virtual reality engine. The see-through display is configured to visually augment an appearance of a physical space to a user viewing the physical space through the see-through display. The virtual reality engine is configured to cause the see-through display to visually present a virtual monitor that appears to be integrated with the physical space to a user viewing the physical space through the see-through display.

Augmented reality virtual monitor

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors on the near-eye display (NED) system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

Growing community of inventors

Seattle, WA, United States of America

Brian James Mount