Intel Corporation

Samsung Display Co., Ltd.

Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Marvellworld Trade Ltd.

Igor V Kozintsev

Yi Wu

Rainer Wolfgang Lienhart

Maha El Choubassi

Yoram Gat

Horst Haussecker

Gabriel Takacs

Carole Dulong

Wei Sun

Kalpana Seshadrinathan

Jean-Yves Bouguet

Neeraj Choubey

Ara Victor Nefian

William W Macy, Jr

Oscar Nestares

Eric L Debes

Minerva M Yeung

Joshua J Ratcliff

Dmitry N Budnikov

Igor V Chikalov

Sergey A Egorychev

Vikas C Raykar

Hong Jiang

Jiang Hong

Ning Lu

Scott Ettinger

Ramkumar Narayanswamy

Garth Shoemaker

Richard T Beckwith

Sergey Nikolaevich Zheltov

Marco Wirasinghe

Philip Muse

Lucas B Ainsworth

Roman Alexeevich Belenov

Kenneth T Anderson

Sheldon L Sun

Marzia Polito

Maria Bezaitis

Joseph A Hook

Michael M Chu

Ermal Dreshaj

Haoran Yi

Michail A Ilyin

Daniel Grobe Sachs

Minerva Ming Lee Yeung

Rainer Lienhart

Alexander N Zaplatin

Vikas Raykar

A method for providing imagery to a user on a display includes receiving eye tracking data, and defining a first tile using the eye tracking data. The first tile has dimensions determined using the eye tracking data. The method also includes defining multiple additional tiles to fill a surrounding area of the display. The method also includes providing a portion of an image using the first tile at a first image quality and providing another portion of the image at a second image quality using at least one of the multiple additional tiles.

Dynamic tiling for foveated rendering

Systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device are disclosed. An example mobile device includes a camera to provide images of a scene from different angles to a server, at least one sensor to sense a position and an orientation of the camera, and a screen to present augmented reality data over the scene based on the position and the orientation of the camera and on a three-dimensional representation of the scene based on the images.

Mobile augmented reality system

A method for providing imagery to a user on a display includes receiving eye tracking data and determining a gaze location on the display or a gaze vector using the eye tracking data. The method can also include defining a first tile using the gaze location on the display or the gaze vector. The first tile may have a height and a width, the height and width being determined using the eye tracking data. The method can further include defining multiple additional tiles to fill an entire area of the display. The method can also include providing a portion of an image using the first tile at a first image quality and providing another portion of the image at a second image quality using at least one of the multiple additional tiles.

Systems, devices and methods are described including receiving a source image having a foreground portion and a background portion, where the background portion includes image content of a three-dimensional (3D) environment. A camera pose of the source image may be determined by comparing features of the source image to image features of target images of the 3D environment and using the camera pose to segment the foreground portion from the background portion may generate a segmented source image. The resulting segmented source image and the associated camera pose may be stored in a networked database. The camera pose and segmented source image may be used to provide a simulation of the foreground portion in a virtual 3D environment.

Networked capture and 3D display of localized, segmented images

A system includes: a display panel; a touch panel; an application processor; a visual accelerator combining video images from the application processor with overlay data in accordance with touch events from the touch panel and parameters from the application processor to supply combined images to the display panel; and memory coupled to the application processor, the memory storing: a request list including acceleration requests; and instructions that, when executed by the application processor, cause the application processor to execute a device driver to: identify an active acceleration request of the acceleration requests, the active acceleration request being associated with an application executed by the application processor; determine an active screen area of the display panel using window arrangement data from a window manager executed by the application processor; generate parameters in accordance with the active acceleration request and the active screen area; and transmit the parameters to the visual accelerator.

System and method in managing low-latency direct control feedback

Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.

Techniques for image synchronization are described herein. The techniques may include a device having logic, at least partially including hardware logic, to implement modules. The modules may include a first sync pulse module to issue a first sync pulse after a first sync pulse offset period to a first imaging sensor. The modules may also include a second sync pulse module to issue a second sync pulse parallel to the first sync pulse after a second sync pulse offset period to a second imaging sensor.

Multi-camera sync pulse synchronization

Examples are disclosed for determining a suggested camera pose or suggested camera settings for a user to capture one or more images. In some examples, the suggested camera pose or suggested camera settings may be based on an indication of the user's interest and gathered information associated with the user's interests. The user may be guided to adjust an actual camera pose or actual camera settings to match the suggested camera pose or suggested camera settings.

Guided image capture

A method for updating a run length encoded (RLE) stream includes: receiving an element having an insertion value to be inserted into the RLE stream at an insertion position, the insertion value having one of a plurality of values, the RLE stream having elements arranged in runs, and each of the elements having one of the values; identifying a run containing the insertion position; determining whether the insertion value is the same as the value of the element at the insertion position; when the insertion value is different from the value of the element at the insertion position: determining whether the insertion position is adjacent to one or more matching runs of the runs, each element of the matching runs having a same value as the insertion value; and extending one of the matching runs when the insertion position is adjacent to only one of the matching runs.

Run length encoding with non-sequential input

Generally, this disclosure provides methods and systems for real-time video communication with three dimensional perception image rendering through generated parallax effects based on identification, segmentation and tracking of foreground and background layers of an image. The system may include an image segmentation module configured to segment a current local video frame into a local foreground layer and a local background layer and to generate a local foreground mask based on an estimated boundary between the local foreground layer and the local background layer; a face tracking module configured to track a position of a local user's face; a background layer estimation module configured to estimate a remote background layer; and an image rendering module configured to render a 3D perception image based on the estimated remote background layer, the current remote video frame and the remote foreground mask.

Video communication with three dimensional perception

Embodiments of the invention describe processing a first image data and 3D point cloud data to extract a first planar segment from the 3D point cloud data. This first planar segment is associated with an object included in the first image data. A second image data is received, the second image data including the object captured in the first image data. A second planar segment related to the object is generated, where the second planar segment is geometrically consistent with the object as captured in the second image data. This planar segment is generated based, at least in part, on the second image data, the first image data and the first planar segment. Embodiments of the invention may further augment the second image data with content associated with the object. This augmented image may be displayed such that the content is displayed geometrically consistent with the second planar segment.

Augmenting image data based on related 3D point cloud data

Growing community of inventors

San Jose, CA, United States of America

Igor V Kozintsev