Thomson Licensing

3dmedia Corporation

Thomson Licensing S.a.

Interdigital Ce Patent Holdings

Izzat Hekmat Izzat

Yousef Wasef Nijim

Dong-Qing Zhang

Youngshik Yoon

Thomas Anthony Stahl

Mary Lafuze Comer

Shu Lin

Mike Arthur Derrenberger

Michael McNamer

Tassos Markas

Edwin Arturo Heredia

Ahmet Mursit Eskicioglu

Bahram Dahi

William Wesley Beyers

Amit Kumar Chatterjee

Saban Kurugay

Sanjeev Nagpal

Tao Zhang

Steven Charles Rhoads

Robert Eugene Trzybinski

Thomas Patrick Newberry

Feng Li

Ning Yao

Robert Trzybinski

Saban Kurucay

A system () and method () for combining and/or displaying text with three-dimensional (3D) content. The system () and method () inserts text at the same level as the highest depth value in the 3D content. As a result, the system () and method () of the present disclosure produces text combined with 3D content wherein the text does not obstruct the 3D effects in the 3D content and does not create visual fatigue when viewed by a viewer.

System and method for combining text with three-dimensional content

A system and method for combining and/or displaying text with three-dimensional content. The system and method inserts text at the same level as the highest depth value in the 3D content. One example of 3D content is a two-dimensional image and an associated depth map. In this case, the depth value of the inserted text is adjusted to match the largest depth value of the given depth map. Another example of 3D content is a plurality of two-dimensional images and associated depth maps. In this case, the depth value of the inserted text is continuously adjusted to match the largest depth value of a given depth map. A further example of 3D content is stereoscopic content having a right eye image and a left eye image. In this case the text in one of the left eye image and right eye image is shifted to match the largest depth value in the stereoscopic image. Yet another example of 3D content is stereoscopic content having a plurality of right eye images and left eye images. In this case the text in one of the left eye images or right eye images is continuously shifted to match the largest depth value in the stereoscopic images. As a result, the system and method of the present disclosure produces text combined with 3D content wherein the text does not obstruct the 3D effects in the 3D content and does not create visual fatigue when viewed by a viewer.

System and method for combining text with three dimensional content

A system and method for spatiotemporal depth extraction of images with forward and backward depth prediction are provided. The system and method of the present disclosure provide for acquiring a plurality of frames, generating a first depth map of a current frame in the plurality of frames based on a depth map of a previous frame in the plurality of frames, generating a second depth map of the current frame in the plurality of frames based on a depth map of a subsequent frame in the plurality of frames, and processing the first depth map and the second depth map to produce a third depth map for the current frame.

System and method for depth extraction of images with forward and backward depth prediction

Methods and Systems are provided for converting a two-dimensional image sequence into a three-dimensional image. In one embodiment, a method for converting a two-dimensional image sequence into a three-dimensional image includes determining camera motion parameters between consecutive images in a monoscopic sequence of reference 2D images, wherein the consecutive images comprise a current reference image and an adjacent image, determining a horizontal disparity map for a target image using the camera motion parameters, determining a disparity probability value for each disparity vector of the disparity map, and determining a target image as a weighted average of pixel values in the current reference image using the disparity probability values, such that the target image and current reference image comprise a stereoscopic image pair.

Method and system for converting 2D image data to stereoscopic image data

A stereoscopic 3-D imaging apparatus has a camera and a wedged optical component attachable to the front of the camera. The wedged optical component is rotatable around the front of the camera using a rotating device, and the rotating device controls the rotation speed of the wedged optical component. The camera is capable of capturing stereoscopic 3-D images, resulting in lower costs and a simple capture process.

Single camera for stereoscopic 3-D capture

A variety of implementations are described. At least one implementation modifies one or more images from a stereo-image pair in order to produce a new image pair that has a different disparity map. The new disparity map satisfies a quality condition that the disparity of the original image pair did not. In one particular implementation, a first image and a second image that form a stereo image pair are accessed. A disparity map is generated for a set of features from the first image that are matched to features in the second image. The set of features is less than all features in the first image. A quality measure is determined based on disparity values in the disparity map. The first image is modified, in response to the determined quality measure, such that disparity for the set of features in the first image is also modified.

Stereo-image quality and disparity/depth indications

An inventive method for video object tracking includes the steps of selecting an object; choosing an object type for the object, and enabling one of multiple object tracking processes responsive to the object type chosen. In a preferred embodiment selecting the object includes one of segmenting the object by using a region, selecting points on the boundary of an object, aggregating regions or combining a selected region and selected points on a boundary of an object. The object tracking processes can be expanded to include tracking processes adapted to newly created object types.

Multi-tracking of video objects

Various implementations relate to improving depth maps. This may be done, for example, by identifying bad depth values and modifying those values. The values may represent, for example, holes and/or noise. According to a general aspect, a segmentation is determined based on an intensity image. The intensity image is associated with a corresponding depth image that includes depth values for corresponding locations in the intensity image. The segmentation is applied to the depth image to segment the depth image into multiple regions. A depth value is modified in the depth image based on the segmentation. A two-stage iterative procedure may be used to improve the segmentation and then modify bad depth values in the improved segmentation, and iterating until a desired level of smoothness is achieved. Both stages may be based, for example, on average depth values in a segment.

Filling holes in depth maps

A system and method for marking a stereoscopic film with colors are provided. The system and method provides for marking a left image with a mark and a right image with a mark having complementary colors, wherein upon viewing, the marks are not visible under certain conditions. The system and method provide for acquiring a stereoscopic image, the stereoscopic image including a first image and a second image, applying a first mark to the first image in a predetermined location, the first mark having a first color, and applying a second mark to the second image in substantially the same predetermined location as in the first image, the second mark having a second color that is different than the first color of the first mark, wherein when viewed in three-dimensional mode, the first mark and the second mark combine into a single mark of one color.

System and method for marking a stereoscopic film

Disclosed herein are primary and auxiliary image capture devices for image processing and related methods. According to an aspect, a method may include using primary and auxiliary image capture devices to perform image processing. The method may include using the primary image capture device to capture a first image of a scene, the first image having a first quality characteristic. Further, the method may include using the auxiliary image capture device to capture a second image of the scene. The second image may have a second quality characteristic. The second quality characteristic may be of lower quality than the first quality characteristic. The method may also include adjusting at least one parameter of one of the captured images to create a plurality of adjusted images for one of approximating and matching the first quality characteristic. Further, the method may include utilizing the adjusted images for image processing.

Primary and auxiliary image capture devcies for image processing and related methods

A system and method for three-dimensional (3D) acquisition and modeling of a scene using two-dimensional (2D) images are provided. The system and method provides for acquiring first and second images of a scene, applying a smoothing function to the first image to make feature points of objects, e.g., corners and edges of the objects, in the scene more visible, applying at least two feature detection functions to the first image to detect feature points of objects in the first image, combining outputs of the at least two feature detection functions to select object feature points to be tracked, applying a smoothing function to the second image, applying a tracking function on the second image to track the selected object feature points, and reconstructing a three-dimensional model of the scene from an output of the tracking function.

System and method for three-dimensional object reconstruction from two-dimensional images

A color look-up table includes a plurality of images recorded on a film. Each of the images being recorded on a separate picture of the film and containing at least a first level and a second level. The first and second levels having different pixel color values and are arranged to form a detectable geometric pattern on each of the pictures. The first field and a second field having detectable boundaries assigned to characterize distortions on the film.

Look-up table on film

A system and method for spatiotemporal depth extraction of images are provided. The system and method provide for acquiring a sequence of images from a scene, the sequence including a plurality of successive frames of images, estimating the disparity of at least one point in a first image with at least one corresponding point in a second image for at least one frame, estimating motion of the at least one point in the first image, estimating the disparity of the at least one next successive frame based on the estimated disparity of at least one previous frame in a forward direction of the sequence, wherein the estimate disparity is compensated with the estimated motion, and minimizing the estimated disparity of each of the plurality of successive frames based on the estimated disparity of at least one previous frame in a backward direction of the sequence.

System and method for depth extraction of images with motion compensation

A color look-up table includes a plurality of images recorded on a film. Each of the images being recorded on a separate picture of the film and containing at least a first level and a second level. The first and second levels having different pixel color values and are arranged to form a detectable geometric pattern on each of the pictures.

Color look-up table on film

A system and method for extracting depth information from at least two images employing region-based filtering for reducing artifacts are provided. The present disclosure provides a post-processing algorithm or function for reducing the artifacts generated by scanline Dynamic Programming (DP) or other similar methods. The system and method provides for acquiring a first image and a second image from a scene, estimating the disparity of at least one point in the first image with at least one corresponding point in the second image to generate a disparity map, segmenting at least one of the first or second images into at least one region, and filtering the disparity map based on the segmented regions. Furthermore, anisotropic filters are employed, which have a great smoothing effect along the vertical direction than that of the horizontal direction, and therefore, reduce stripe artifacts without significantly blurring the depth boundaries.

Growing community of inventors

Carmel, IN, United States of America

Izzat Hekmat Izzat