Intel Corporation

Maha El Choubassi

Yi Wu

Igor V Kozintsev

Oscar Nestares

Gabriel Takacs

Joshua J Ratcliff

Kalpana Seshadrinathan

Alexey Supikov

Richard T Beckwith

Yoram Gat

Yan Xu

Horst Haussecker

Wei Sun

Fan Zhang

Kenneth T Anderson

Sung Hee Park

Maria Bezaitis

Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.

High-speed video from camera arrays

Systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device are disclosed. An example mobile device includes a camera to provide images of a scene from different angles to a server, at least one sensor to sense a position and an orientation of the camera, and a screen to present augmented reality data over the scene based on the position and the orientation of the camera and on a three-dimensional representation of the scene based on the images.

Mobile augmented reality system

An apparatus for high-speed video is described herein. The apparatus includes a camera array, wherein each camera of the camera array is to capture an image at a different time offset resulting in a plurality of images. The apparatus also includes a controller to interleave the plurality of images in chronological order and a view synthesis unit to synthesize a camera view from a virtual camera for each image of the plurality of images. Additionally, the apparatus includes a post-processing unit to remove any remaining artifacts from the plurality of images.

A plurality of frames of a video recorded by a video camera and depth maps of the plurality of frames are stored in a data storage. One or more target video camera positions are determined. Each frame of the plurality of frames is associated with one or more of the target video camera positions. For each frame, one or more synthesized frames from the viewpoint of the one or more target camera positions associated with that frame are generated by applying a view interpolation algorithm to that frame using the color pixels of that frame and the depth map of that frame. Users can provide their input about the new camera positions and other camera parameters through multiple input modalities. The synthesized frames are concatenated to create a modified video. Other embodiments are also described and claimed.

View interpolation for visual storytelling

Techniques related to multiview video stabilization are discussed. Such techniques may include performing single view video stabilization on a reference video stream and propagating the single view video stabilization to another video stream based on a target disparity map.

Multiview video stabilization

Systems, devices and methods are described including receiving a source image having a foreground portion and a background portion, where the background portion includes image content of a three-dimensional (3D) environment. A camera pose of the source image may be determined by comparing features of the source image to image features of target images of the 3D environment and using the camera pose to segment the foreground portion from the background portion may generate a segmented source image. The resulting segmented source image and the associated camera pose may be stored in a networked database. The camera pose and segmented source image may be used to provide a simulation of the foreground portion in a virtual 3D environment.

Networked capture and 3D display of localized, segmented images

Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.

This application is directed to dynamic control for data capture. A device may comprise a capture logic module to receive at least one of biometric data from a biometric sensing module, context data from a context sensing module or content data from a content sensing module. The capture logic module may determine if a capture scenario exists based on at least one of the biometric data and context data. The determination may be weighted based on an operational mode. If a capture scenario is determined to exist, the capture logic module may then determine whether to capture data based on at least the content data. Captured data may be stored in a capture database in the device (e.g., along with enhanced metadata based on at least one of the biometric data, the context data or the content data). The device may also comprise a feedback database including feedback data.

Dynamic control for data capture

Techniques related to filling hole regions in a disparity map are discussed. Such techniques may include generating approximated disparity values for grid nodes of an approximation grid having a lower resolution than the disparity map based on disparity values within outer hole contour regions circumscribing the hole regions. The hole regions may be filled with upsampled disparity values based on the approximated disparity values to provide a final disparity map.

Filling disparity holes based on resolution decoupling

Examples are disclosed for determining a suggested camera pose or suggested camera settings for a user to capture one or more images. In some examples, the suggested camera pose or suggested camera settings may be based on an indication of the user's interest and gathered information associated with the user's interests. The user may be guided to adjust an actual camera pose or actual camera settings to match the suggested camera pose or suggested camera settings.

Guided image capture

An image processing apparatus, system, and method to automatically determine a plurality of image acquisition settings for an scene; acquire a set of images of the scene, the set of images including multiple images acquired with a distinct plurality of the determined image acquisition settings; and generate a single image by combining the acquired set of images.

Method and system for perfect shot imaging from multiple images

Embodiments of the invention describe processing a first image data and 3D point cloud data to extract a first planar segment from the 3D point cloud data. This first planar segment is associated with an object included in the first image data. A second image data is received, the second image data including the object captured in the first image data. A second planar segment related to the object is generated, where the second planar segment is geometrically consistent with the object as captured in the second image data. This planar segment is generated based, at least in part, on the second image data, the first image data and the first planar segment. Embodiments of the invention may further augment the second image data with content associated with the object. This augmented image may be displayed such that the content is displayed geometrically consistent with the second planar segment.

Growing community of inventors

San Jose, CA, United States of America

Maha El Choubassi