Microsoft Technology Licensing, LLC

Amazon Technologies, Inc.

Forrest Power Trepte

Quais Taraki

Semih Energin

John Russell Seghers

Noah Lake Callaway

James Jefferson Gault

Robin Dale Reigstad, Jr

Brian Lloyd Schmidt

Todor J Fay

David G Yackley

Improved video compression and video streaming systems and methods are disclosed for environments where camera motion is common, such as cameras incorporated into head-mounted displays. This is accomplished by combining a 3D representation of the shape of the user's environment (walls, floor, ceiling, furniture, etc.), image data, and data representative of changes in the location and orientation (pose) of the camera between successive image frames, thereby reducing data bandwidth needed to send streaming video in the presence of camera motion.

Reprojecting holographic video to enhance streaming bandwidth/quality

Techniques for coordination of content presentation operations are described herein. In some cases, a client may generate client metadata associated with client event data. The client metadata may include, for example, an indication of any one or more of a time, a frame, a location, an angle, a direction, a speed, a force, or other information associated with the client event data. Also, in some cases, the content provider may generate content provider metadata associated with image data. For example, the content provider metadata may indicate a location of a virtual camera associated with the respective image data and/or a location of one or more objects represented within the respective image data.

Coordination of content presentation operations

Methods and systems for displaying an image as a virtual representation of an object based upon detected external light are described. An illustrative computer-implemented method includes steps of detecting the ambient light of an environment, such as a room, at a display surface. Data representative of the detected ambient light is processed to determine a direction of the detected light with respect to the display surface. An image is displayed on the display surface as a virtual representation of an object based upon the detected ambient light. Shadowing affects may be displayed to create the appearance that the virtual representation of the object casts a shadow on the display surface. Physical objects placed against or near to the surface of the display surface may also have images displayed on the display surface corresponding to shadows created by the ambient light.

Object illumination in a virtual environment

For use with an interactive display system having a generally horizontal interactive display surface, four speakers that are disposed at spaced-apart locations within a housing of the system so that a sound field produced by one or more energized speakers is directed outwardly as desired. A personal computer (PC) selectively energizes one or more of the speakers in accord with a predefined criteria so that a direction of the sound field produced is generally consistent with the disposition of a user, or a state of a software application, or a disposition of a virtual object on the interactive display surface. In one embodiment, each of the speakers is mounted in a different side or end of the interactive display system. In another embodiment, the speakers are mounted at the corners of the housing. One or more of the speakers are energized at a time to produce the desired sound field.

Positioning audio output for users surrounding an interactive display surface

A script file includes a text section that has a text label to designate a point during execution of the script sequence when an audio rendition of a video event is to be initiated. The script file also includes a container that maintains audio content within the script file. The audio content is identified in the container with a content label that corresponds to a text label in the text section. The audio content is initiated to be generated as the audio rendition at the designated point during execution of the script sequence when the script file is executed and when a script processor determines that the content label corresponds to the text label.

Growing community of inventors

Redmond, WA, United States of America

Forrest Power Trepte