Intel Corporation

Oscar Nestares

Kalpana Seshadrinathan

Yi Wu

Gowri Somanath

Fan Zhang

Horst Haussecker

Maha El Choubassi

Scott Ettinger

Niloufar Pourian

Wei Sun

Yoram Gat

Ginni Grover

Tao Ma

Yong Jiang

Igor V Kozintsev

Basel Salahieh

Daniel C Middleton

Lucas B Ainsworth

Sung Hee Park

Vladan Popovic

Dinesh Jayaraman

Bindita Chaudhuri

David W Browning

Jianping Zhou

Zhiming Zhuang

Sreenath Kurupati

Joshua J Ratcliff

Jun Jiang

Madhu S Athreya

Alexey Supikov

Richard T Beckwith

Ronald T Azuma

James Granger

Michael P Dierks

Yan Xu

Ali Mehdizadeh

Prasanna Mulgaonkar

Sheethal Bhat

Max T Stein

Badusha Kalathiparambil

Techniques related to multi-level optical flow estimation are discussed. Such techniques include partitioning each pair of input images into one or more partitions, separately performing optical flow estimation on the partitions, and merging the separately generated optical flow results into a final optical flow map for the pair of input images.

Multi-level optical flow estimation framework for stereo pairs of images based on spatial partitioning

A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.

Cinematic space-time view synthesis for enhanced viewing experiences in computing environments

Techniques related to optical flow estimation for equirectangular images are discussed. Such techniques include combining an optical flow map generated using an input pair of equirectangular images and an optical flow map generated using a transformed pair of equirectangular images rotated with respect to the input pair to move polar regions in the input pair to central regions in the transformed pair.

Accurate optical flow estimation in stereo pairs of equirectangular images

Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.

High-speed video from camera arrays

An example system for generating light field content is described herein. The system includes a receiver to receive a plurality of images and a calibrator to intrinsically calibrate a camera. The system also includes a corrector and projector undistort the images and project the undistorted images to generate undistorted rectilinear images. An extrinsic calibrator may rectify and align the undistorted rectilinear images. Finally, the system includes a view interpolator to perform intermediate view interpolation on the rectified and aligned undistorted rectilinear images.

Generating virtual reality content via light fields

An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.

Generating stereoscopic light field panoramas using concentric viewing circles

An example method is described herein. The method includes executing dense feature matching on an image pair that is down sampled to obtain a first set of feature correspondences for each pixel of the down sampled image pair. The method also includes calculating a neighborhood correspondence based on the first set of feature correspondences for each pixel in a first image of the image pair. Further, the method includes executing sparse feature matching on stereoscopic patch pairs from the image pair based on the neighborhood correspondence for each pixel to obtain correspondence estimates for each stereoscopic patch pair. Finally, the method includes refining the correspondence estimates for each stereoscopic patch pair to obtain a semi-dense set of feature correspondences by applying a geometric constraint to the correspondence estimates and retaining correspondences that satisfy the geometric constraint.

Guided sparse feature matching via coarsely defined dense matches

An apparatus for high-speed video is described herein. The apparatus includes a camera array, wherein each camera of the camera array is to capture an image at a different time offset resulting in a plurality of images. The apparatus also includes a controller to interleave the plurality of images in chronological order and a view synthesis unit to synthesize a camera view from a virtual camera for each image of the plurality of images. Additionally, the apparatus includes a post-processing unit to remove any remaining artifacts from the plurality of images.

Disclosed herein is display stacks for virtual reality (VR) displays arranged to present an image where a focal point of the image is presented in higher resolution than a periphery around the focal point. The disclosure provides systems and methods for presenting an image comprising a high resolution having a smaller field of view than that with which a lower resolution image is presented around a periphery of the high resolution image.

Foveated virtual reality near eye displays

Technology for improving performance of a personal display device by variably controlling the emission divergence and/or the emission direction of light from the pixels of the display as a function of the location of the pixel within a display.

Head mounted display including variable beam divergence and/or beam direction

Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying a convolution mask that approximates an inverse of a linear combination of at least the horizontal and vertical convolution matrices representative of gradient detection in the input images to a virtual intermediate gradient image that is a combination of at least an interpolated virtual image at the position, an interpolated horizontal gradient map at the position, and an interpolated vertical gradient map at the position to generate a final virtual image for the position.

Virtual view interpolation between camera views for immersive visual experience

An example system for generating stereoscopic light field panoramas includes a receiver to receive a plurality of synchronized images. The system also includes a calibrator and projector to calibrate the synchronized images, undistort the synchronized images, and project the undistorted images to a sphere to generate undistorted rectilinear images. The system further includes a disparity estimator to estimate a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images. The system includes a view interpolator to perform in-between view interpolation on the undistorted rectilinear images based on the optical flow. The system also further includes a light field panorama generator to generate a stereoscopic light field panorama for a plurality of perspectives using concentric viewing circles.

Techniques related to feature detection and matching fisheye images are discussed. Such techniques include determining a geometric constraint for the feature matching using match results from a first image based feature matching and generating resultant matches based on applying the geometric constraint and a second image based feature matching that applies a looser image based feature matching requirement than the image based feature matching.

End to end framework for geometry-aware multi-scale keypoint detection and matching in fisheye images

Growing community of inventors

San Jose, CA, United States of America

Oscar Nestares