Microsoft Technology Licensing, LLC

Victor Lempitsky

Carsten Rother

Pushmeet Kohli

Andrew Blake

Olga Barinova

An object detection system is disclosed herein. The object detection system allows detection of one or more objects of interest using a probabilistic model. The probabilistic model may include voting elements usable to determine which hypotheses for locations of objects are probabilistically valid. The object detection system may apply an optimization algorithm such as a simple greedy algorithm to find hypotheses that optimize or maximize a posterior probability or log-posterior of the probabilistic model or a hypothesis receiving a maximal probabilistic vote from the voting elements in a respective iteration of the algorithm. Locations of detected objects may then be ascertained based on the found hypotheses.

Detecting and localizing multiple objects in images using probabilistic inference

A method of labeling pixels in an image is described where the pixel label is selected from a set of three or more labels. The pixel labeling problem is reduced to a sequence of binary optimizations by representing the label value for each pixel as a binary word and then optimizing the value of each bit within the word, starting with the most significant bit. Data which has been learned from one or more training images is used in the optimization to provide information about the less significant bits within the word.

Optimization of multi-label problems in computer vision

An image processing system is described which automatically labels image elements of a digital image. In an embodiment an energy function describing the quality of possible labelings of an image is globally optimized to find an output labeled image. In the embodiment, the energy function comprises terms that depend on at least one non-local parameter. For example, the non-local parameter describes characteristics of image elements having the same label. In an embodiment the global optimization is achieved in a practical, efficient manner by using a tree structure to represent candidate values of the non-local parameter and by using a branch and bound process. In some embodiments, the branch and bound process comprises evaluating a lower bound of the energy function by using a min-cut process. For example, the min-cut process enables the lower bound to be evaluated efficiently using a graphical data structure to represent the lower bound.

Labeling image elements

Multi-scale processing may be used to reduce the memory and computational requirements of optimization algorithms for image labeling, for example, for object segmentation, 3D reconstruction, stereo correspondence, optical flow and other applications. For example, in order to label a large image (or 3D volume) a multi-scale process first solves the problem at a low resolution, obtaining a coarse labeling of an original high resolution problem. This labeling is refined by solving another optimization on a subset of the image elements. In examples, an energy function for a coarse level version of an input image is formed directly from an energy function of the input image. In examples, the subset of image elements may be selected using a measure of confidence in the labeling.

Growing community of inventors

Oxford, United Kingdom

Victor Lempitsky