Eastman-kodak Company

Omnivision Technologies, Inc.

Kodak Alaris Inc.

Intellectual Ventures Fund 83 LLC

Apple Inc.

Reald Inc.

Mrityunjay Kumar

Bruce Harold Pillman

James E Adams, Jr

Alexander C Loui

Jiebo Luo

James A Hamilton

Rodney L Miller

Efrain Orlando Morales

Abdolreza Abdolhosseini Moghadam

Zheshen Wang

Minwoo Park

David D Conger

Jon Karafin

Jr James E Adams

James Andrew Hamilton

A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. The video sequence is segmented into scenes by identifying scene boundaries based on the determined video frame clusters.

Identifying scene boundaries using group sparsity analysis

Systems, devices, and methods disclosed herein may apply a computational spatial-temporal analysis to assess pixels between temporal and/or perspective view imagery to determine imaging details that may be used to generate image data with increased signal-to-noise ratio.

Image mastering systems and methods

A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. A summary is formed based on the determined video frame clusters.

Video summarization using group sparsity analysis

A method for representing a video sequence including a time sequence of input video frames, the input video frames including some common scene content that is common to all of the input video frames and some dynamic scene content that changes between at least some of the input video frames. Affine transform are determined to align the common scene content in the input video frames. A common video frame including the common scene content is determined by forming a sparse combination of a first basis functions. A dynamic video frame is determined for each input video frame by forming a sparse combination of a second basis functions, wherein the dynamic video frames can be combined with the respective affine transforms and the common video frame to provide reconstructed video frames.

Video representation using a sparsity-based model

A method for determining a scene boundary location dividing a first scene and a second scene in an input video sequence. The scene boundary location is determined responsive to a merit function value, which is a function of the candidate scene boundary location. The merit function value for a particular candidate scene boundary location is determined by representing the dynamic scene content for the input video frames before and after candidate scene boundary using sparse combinations of a set of basis functions, wherein the sparse combinations of the basis functions are determined by finding a sparse vector of weighting coefficients for each of the basis functions. The weighting coefficients determined for each of the input video frames are combined to determine the merit function value. The candidate scene boundary providing the smallest merit function value is designated to be the scene boundary location.

Scene boundary determination using sparsity-based model

A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. A set of key video frames are selected based on the determined video frame clusters.

Identifying key frames using group sparsity analysis

A method for producing a noise-reduced digital image captured using a digital imaging system having signal-dependent noise characteristics, comprising: capturing one or more noisy digital images of a scene, wherein said at least one noisy digital image has signal-dependent noise characteristics; defining a functional relationship to relate the noisy digital images to a noise-reduced digital image, wherein the functional relationship includes at least two sets of unknown parameters, and wherein at least one of the sets of unknown parameters relates to the signal-dependent noise characteristics; defining an energy function responsive to the functional relationship which includes at least a data fidelity term to enforce similarities between the noisy digital images and the noise-reduced digital image, and a spatial fidelity term to encourage sharp edges in the noise-reduced digital image; and using an optimization process to determine a noise-reduced image responsive to the energy function.

Reducing signal-dependent noise in digital cameras

A method for identifying a set of key frames from a video sequence including a time sequence of video frames, the method executed at least in part by a data processor, comprising: selecting a set of video frames from the video sequence; identifying a plurality of visually homogeneous regions from each of the selected video frames; defining a set of basis functions, wherein each basis function is associated with a different visually homogeneous region; determining a feature vector for each of the selected video frames; representing each of the determined feature vectors as a sparse combination of the basis functions; for each of the determined feature vectors, determining a sparse set of video frames that contain the visually homogeneous regions corresponding to the basis functions included in the corresponding sparse combination of the basis functions; and analyzing the sparse sets of video frames to identify the set of key frames.

Video key-frame extraction using bi-level sparsity

A method for determining a video summary from a video sequence including a time sequence of video frames, comprising: defining a global feature vector representing the entire video sequence; selecting a plurality of subsets of the video frames; extracting a frame feature vector for each video frame in the selected subsets of video frames; defining a set of basis functions, wherein each basis function is associated with the frame feature vectors for the video frames in a particular subset of video frames; using a data processor to automatically determine a sparse combination of the basis functions representing the global feature vector; determining a summary set of video frames responsive to the sparse combination of the basis functions; and forming the video summary responsive to the summary set of video frames.

Video summarization using sparse basis function combination

A method for identifying high saliency regions in a digital image, comprising: segmenting the digital image into a plurality of segmented regions; determining a saliency value for each segmented region, merging neighboring segmented regions that share a common boundary in response to determining that one or more specified merging criteria are satisfied; and designating one or more of the segmented regions to be high saliency regions. The determination of the saliency value for a segmented region includes: determining a surround region including a set of image pixels surrounding the segmented region; analyzing the image pixels in the segmented region to determine one or more segmented region attributes; analyzing the image pixels in the surround region to determine one or more corresponding surround region attributes; determining a region saliency value responsive to differences between the one or more segmented region attributes and the corresponding surround region attributes.

Identifying high saliency regions in digital images

A method for reducing noise in an image captured using a digital image sensor having pixels being arranged in a rectangular minimal repeating unit, comprising: computing first weighted pixel differences by combining first pixel differences between the pixel value of a central pixel and pixel values for nearby pixels of the first channel in a plurality of directions with corresponding local edge-responsive weighting values; computing second weighted pixel differences by combining second pixel differences between pixel values for pixels of at least one different channel in the plurality of directions with corresponding local edge-responsive weighting values; and computing a noise-reduced pixel value for the central pixel by combining the first and second weighted pixel differences with the pixel value for the central pixel.

Denoising CFA images using weighted pixel differences

A method for sharpening an input digital image captured using a digital camera having a zoom lens, determining a parameterized representation of lens acuity of the zoom lens as a function of at least the lens focal length and lens F# by fitting a parameterized function to lens acuity data for the zoom lens at a plurality of lens focal length and lens F/#; using a processor to sharpen the input digital image responsive to the particular lens focal length and lens F/#corresponding to the input digital image using the parameterized representation of the lens acuity.

Zoom lens system characterization for image sharpening

A method for reducing noise in a color image captured using a digital image sensor having pixels being arranged in a rectangular minimal repeating unit. The method comprises, for a first color channel, determining noise reduced-pixel values using a first noise reducing process that includes computing weighted pixel differences by combining the pixel differences with corresponding local edge-responsive weighting values. The method further comprises a second noise reducing process that includes computing weighted chroma differences by combining chroma differences with corresponding local edge-responsive weighting values.

Growing community of inventors

Rochester, NY, United States of America

Mrityunjay Kumar