Yissum Research Development Company of the Hebrew University of Jerusalem Ltd.

Microsoft Technology Licensing, LLC

Briefcam Ltd.

Alexander Rav-Acha

Shmuel Peleg

Yael Pritch

Avital Gutman

Andrew William Fitzgibbon

Pushmeet Kohli

Carsten Rother

Daniel Lischinski

A method and apparatus for processing video is disclosed. In an embodiment, image features of an object within a frame of video footage are identified and the movement of each of these features is tracked throughout the video footage to determine its trajectory (track). The tracks are analyzed, the maximum separation of the tracks is determined and used to determine a texture map, which is in turn interpolated to provide an unwrap mosaic for the object. The process may be iterated to provide an improved mosaic. Effects or artwork can be overlaid on this mosaic and the edited mosaic can be warped via the mapping, and combined with layers of the original footage. The effect or artwork may move with the object's surface.

Video processing

In a system and method for generating a synopsis video from a source video, at least three different source objects are selected according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video. One or more synopsis objects are sampled from each selected source object by temporal sampling using image points derived from specified time periods. For each synopsis object a respective time for starting its display in the synopsis video is determined, and for each synopsis object and each frame a respective color transformation for displaying the synopsis object may be determined. The synopsis video is displayed by displaying selected synopsis objects at their respective time and color transformation, such that in the synopsis video at least three points that each derive from different respective times in the source video are displayed simultaneously.

Method and system for video indexing and video synopsis

A computer-implemented method and system transforms a first sequence of video frames of a first dynamic scene to a second sequence of at least two video frames depicting a second dynamic scene. A subset of video frames in the first sequence is obtained that show movement of at least one object having a plurality of pixels located at respective x, y coordinates and portions from the subset are selected that show non-spatially overlapping appearances of the at least one object in the first dynamic scene. The portions are copied from at least three different input frames to at least two successive frames of the second sequence without changing the respective x, y coordinates of the pixels in the object and such that at least one of the frames of the second sequence contains at least two portions that appear at different frames in the first sequence.

Method and system for producing a video synopsis

A respective intensity gradient of a first spatially aligned pixel in each frame of a sequence of images is multiplied by a respective intensity or function thereof of a second pixel in the new frame, this being done for all pixels in the set and the resulting products being summed. This is repeated so that in one of the sums the first and second pixels have identical locations in the respective frames and where in each additional sum the second pixel is shifted by a non-zero shift relative to its location in other sums. The transformation is computed using intensity and gradient values of the image frames in the sequence and the sums. Weighted averages of at least two of the sums are stored and used together with the intensity and gradient values of the frames in the sequence to re-compute the transformation.

Fast and robust motion computations using direct methods

A computer-implemented method and system for transforming a first sequence of video frames of a first dynamic scene captured at regular time intervals to a second sequence of video frames depicting a second dynamic scene wherein for at least two successive frames of the second sequence, there are selected from at least three different frames of the first sequence portions that are spatially contiguous in the first dynamic scene and copied to a corresponding frame of the second sequence so as to maintain their spatial continuity in the first sequence. In a second aspect, for at least one feature in the first dynamic scene respective portions of the first sequence of video frames are sampled at a different rate than surrounding portions of the first sequence of video frames; and the sampled portions are copied to a corresponding frame of the second sequence.

Growing community of inventors

Jerusalem, Israel

Alexander Rav-Acha