The University of North Carolina at Chapel Hill

Anselmo A Lastra

Henry Fuchs

Andrei State

Gregory Francis Welch

Jan-Michael Frahm

David Paul Perra

Voicu S Popescu

John G Eyles

John Turner Whitted

Feng Zheng

Nate Michael Dierk

Methods, systems, and computer readable media for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays are disclosed. According to one aspect, a method for minimal-latency tracking and display for matching real and virtual worlds in head-worn displays includes calculating a desired image, calculating an error image as the difference between the desired image and an image currently being perceived by a user, identifying as an error portion a portion of the error image having the largest error, updating a portion of a projected image that corresponds to the error portion, and recalculating the image currently being perceived by a user based on the updated projected image.

Minimal-latency tracking and display for matching real and virtual worlds in head-worn displays

Methods, systems, and computer readable media for low latency stabilization for head-worn displays are disclosed. According to one aspect, the subject matter described herein includes a system for low latency stabilization of a head-worn display. The system includes a low latency pose tracker having one or more rolling-shutter cameras that capture a 2D image by exposing each row of a frame at a later point in time than the previous row and that output image data row by row, and a tracking module for receiving image data row by row and using that data to generate a local appearance manifold. The generated manifold is used to track camera movements, which are used to produce a pose estimate.

Low latency stabilization for head-worn displays

Methods and apparatus for rendering images are presented. The method includes the step of segmenting at least one reference image in a reference image space into a plurality of tiles, each tile defined by a corresponding set of image samples. The connectivity of each of the samples is determined based on the relative curvature of a surface of the corresponding tile at the sample coordinates. Color and depth information between adjacent, connected samples is bi-linearly interpolated to form a corresponding set of sub-samples. The set of sub-samples are warped from the reference image space to a destination image space. A final pixel color for each of a plurality of groups of sub-samples in the destination image space is computed as a weighted average of the color information of the sub-samples for each respective group. The final pixel colors are combined to render a final image in the destination image space from the at least one reference image.

Methods and apparatus for rendering images using 3D warping techniques

Growing community of inventors

Chapel Hill, NC, United States of America

Anselmo A Lastra