Adobe, Inc.

Nvidia Corporation

The State University of New York

Qi Sun

Li-Yi Wei

David Patrick Luebke

Aaron Eliot Lefohn

Anjul Patney

Morgan McGuire

Omer Shapira

Jingwan Lu

Paul John Asente

Byungmoon Kim

Gavin Stuart Peter Miller

Jose Ignacio Echevarria Vallespi

Arie E Kaufman

Joon-Young Lee

Stefano Petrangeli

Jonathan Eisenmann

Tong Sun

Curtis Michael Wigington

Joohwan Kim

Fu-Chung Huang

Xin Sun

Jinwoong Jung

Tenell Glen Rhodes, Jr

Jing Qian

Shaoyu Chen

A method includes accessing a first object in a virtual environment, the first object representing a first asset at a first level of detail (LoD). A second object is generated to represent the first asset at a second LoD having decreased complexity. The method further includes determining a first importance value for the first asset and, based on the first importance value, selecting the first object to represent the first asset. Additionally, the method includes accessing a third object representing the second asset at the first LoD and generating a fourth object representing the second asset at the second LoD. The method further includes determining a second importance value, lower than the first importance value, for the second asset and selecting the fourth object to represent the second asset. The method further includes causing a client device to update a display of the virtual environment by transmitting the selected objects.

Delivering a virtual environment with dynamic level of detail per object

Techniques are disclosed for sharing user markings between digital documents and corresponding physically printed documents. The sharing is facilitated using an Augmented Reality (AR) device, such as a smartphone or a tablet. The device streams images of a page of a book on a display. The device accesses a corresponding digital document that is a digital version of content printed on the book. In an example, the digital document has a digital user marking, e.g., a comment associated with a paragraph of the digital document, wherein a corresponding paragraph of the physical book lacks any such comment. When the device streams the images of the page of the book on the display, the device appends the digital comment on the paragraph of the page of the book within the image stream. Thus, the user can view the digital comment in the AR environment, while reading the physical book.

Sharing of user markings between printed and digital documents

Embodiments herein describe a framework for classifying images. In some embodiments, it is determined whether an image includes synthetic image content. If it does, characteristics of the image are analyzed to determine if the image includes characteristics particular to panoramic images (e.g., possess a threshold equivalency of pixel values among the top and/or bottom boundaries of the image, or a difference between summed pixel values of the pixels comprising the right vertical boundary of the image and summed pixel values of the pixels comprising the left vertical boundary of the image being less than or equal to a threshold value). If the image includes characteristics particular to panoramic images, the image is classified as a synthetic panoramic image. If the image is determined to not include synthetic image content, a neural network is applied to the image and the image is classified as one of non-synthetic panoramic or non-synthetic non-panoramic.

Classifying panoramic images

Methods and systems are provided for performing dynamic mapping between a virtual environment and a real-world space. During dynamic mapping, a current virtual scene of the virtual environment that is within view of a user is prioritized over areas of the virtual environment that are out of view. The dynamic mapping between the virtual environment and the real-world space can be utilized to render a virtual scene for user in real-time. As a user interacts and/or moves within the virtual environment, dynamic mapping can be performed in real-time to capture any dynamic changes to the real-world space and/or the virtual environment.

Dynamic mapping of virtual and physical interactions

A method, computer readable medium, and system are disclosed for redirecting a user's movement through a physical space while the user views a virtual environment. A temporary visual suppression event is detected when a user's eyes move relative to the user's head while viewing a virtual scene displayed on a display device, an orientation of the virtual scene relative to the user is modified to direct the user to physically move along a planned path through a virtual environment corresponding to the virtual scene, and the virtual scene is displayed on the display device according to the modified orientation.

Saccadic redirection for virtual reality locomotion

An augmented reality display alternates between displaying color frames and alpha frames to generate composite images for transparency control. A display processor includes two sets of buffers, each set including a color frame buffer and an alpha frame buffer. One set of buffers is used to provide data to the display while new video data is being written into the other set of buffers. The display processor switches which set of buffers is providing data and which set of buffers is having new video data written into them. By switching the alpha and color frame buffers in sets, a pair of color frame buffer and alpha frame buffer are always the current set of buffers to provide data as the output. If a frame drop occurs and the next color frame or alpha frame is not ready, the set of buffers is not switched to avoid disturbing flashing visual artifacts.

Controlling an augmented reality display with transparency control using multiple sets of video buffers

A method, computer readable medium, and system are disclosed for computing a path for a user to move along within a physical space while viewing a virtual environment in a virtual reality system. A path for a user to physically move along through a virtual environment is determined based on waypoints and at least one characteristic of the physical environment within which the user is positioned, position data for the user is received indicating whether and how much a current path taken by the user has deviated from the path, and an updated path is computed through the virtual environment based on the waypoints and the at least one characteristic of the physical environment.

Path planning for virtual reality locomotion

A system of generating a progressive representation associated with virtual and physical reality image data is disclosed. The system receives virtual image data associated with a virtual scene map of a virtual scene, and receives physical image data from the image capturing device, associated with a physical environment of a real scene. Perimeter information of the physical environment is determined. Boundary information of an obstacle associated with the physical environment is determined. A real scene map associated with the physical environment including an obstacle and one or more free space areas is generated. A corresponding virtual barrier is generated in the real scene map, the virtual barrier associated with the boundary information of the obstacle in the real scene map. A folding of the virtual scene map into the one or more free space areas of the real scene map is implemented, the free space areas surround or are adjacent the generated virtual barrier. A progressive representation to the wearable communication device is generated that is associated with virtual scene pixels of the virtual map corresponding to real scene points of the real scene map in a time interval. A corresponding method and computer-readable device are also disclosed.

System and method for generating a progressive representation associated with surjectively mapped virtual and physical reality image data

A method, computer readable medium, and system are disclosed for adjusting an angular sampling rate during rendering. The method includes the steps of determining a location of a gaze within a displayed scene, and adjusting, during a rendering of the scene, an angular sampling rate used to render at least a portion of the scene, based on the location of the gaze within the displayed scene.

Adjusting an angular sampling rate during rendering utilizing gaze information

Growing community of inventors

Centereach, NY, United States of America

Qi Sun