Amazon Technologies, Inc.

Microsoft Technology Licensing, LLC

Semih Energin

John Russell Seghers

Sergio Paolantonio

Robert Thomas Held

Anatolie Gavriliuc

Andrew Frederick Muehlhausen

Maxime Ouellet

Riccardo Giraldi

Quais Taraki

Forrest Power Trepte

Noah Lake Callaway

James Jefferson Gault

Robin Dale Reigstad, Jr

Jeffrey Jesus Evertt

Eric Scott Rehmeyer

David Anthony Evans

David Evans

An improved human-computer interface ('HCI') is disclosed herein for viewing a three-dimensional (“3D”) representation of a real-world environment from different, changing, and/or multiple perspectives. An AR device may capture, in real-time, a 3D representation of a scene using a surface reconstruction (“SR”) camera and a traditional Red Green & Blue (“RGB”) camera. The 3D representation may be transmitted to and viewed on a user's computing device, enabling the user to navigate the 3D representation. The user may view the 3D representation in a free-third-person mode, enabling the user to virtually walk or fly through the representation captured by the AR device. The user may also select a floor plan mode for a top-down or isomorphic perspective. Enabling a user to view a scene from different perspectives enhances understanding, speeds trouble-shooting, and fundamentally improves the capability of the computing device, the AR device, and the combination thereof.

Re-creation of virtual environment through a video call

An improved human-computer interface ('HCI') is disclosed herein for viewing a three-dimensional ('3D') representation of a real-world environment from different, changing, and/or multiple perspectives. An AR device may capture, in real-time, a 3D representation of a scene using a surface reconstruction (&#x201c;SR&#x201d;) camera and a traditional Red Green & Blue (&#x201c;RGB&#x201d;) camera. The 3D representation may be transmitted to and viewed on a user's computing device, enabling the user to navigate the 3D representation. The user may view the 3D representation in a free-third-person mode, enabling the user to virtually walk or fly through the representation captured by the AR device. The user may also select a floor plan mode for a top-down or isomorphic perspective. Enabling a user to view a scene from different perspectives enhances understanding, speeds trouble-shooting, and fundamentally improves the capability of the computing device, the AR device, and the combination thereof.

Techniques for coordination of content presentation operations are described herein. In some cases, a client may generate client metadata associated with client event data. The client metadata may include, for example, an indication of any one or more of a time, a frame, a location, an angle, a direction, a speed, a force, or other information associated with the client event data. Also, in some cases, the content provider may generate content provider metadata associated with image data. For example, the content provider metadata may indicate a location of a virtual camera associated with the respective image data and/or a location of one or more objects represented within the respective image data.

Coordination of content presentation operations

A method for moving a virtual object includes displaying a virtual object and moving the virtual object based on a user input. Based on the user input attempting to move the virtual object in violation of an obstacle, displaying a collision indicator and an input indicator. The collision indicator is moved based on user input and movement constraints imposed by the obstacle. The input indicator is moved based on user input without movement constraints imposed by the obstacle.

Virtual object movement

A technique is described herein for presenting notifications associated with applications in a context-based manner. In one implementation, the technique maintains a data store that provides application annotation information that describes a plurality of anchors. For instance, the application annotation information for an illustrative anchor identifies: a location at which the anchor is virtually placed in an interactive world; an application associated with the anchor; and triggering information that describes a set of one or more triggering conditions to be satisfied to enable presentation of a notification pertaining to the application. In use, the technique presents the notification pertaining to the application in prescribed proximity to the anchor when it is determined that the user's engagement with the interactive world satisfies the anchor's set of triggering conditions. The triggering conditions can specify any combination of spatial factors, temporal factors, user co-presence factors, etc.

Context-based discovery of applications

Techniques for enabling selection of one or more viewports from a scene representation are disclosed herein. In some aspects, scene configuration information including a position of at least one viewport relative to the scene may be received. Each of the at least one viewport may be associated with a streaming camera view. A scene representation may then be defined based, at least in part, on the scene configuration information. One or more viewport representations corresponding to each of the at least one viewport may be positioned within the scene representation, based, at least in part on, the scene configuration information. The scene representation, including the at least one viewport representation, may be displayed, for example, to a user. Each viewport representation may allow the respective streaming camera view associated with the corresponding viewport may to be displayed, such as by selection of each viewport representation.

Viewport selection system

Growing community of inventors

Seattle, WA, United States of America

Semih Energin