Kabushiki Kaisha Toshiba

Bjorn Stenger

Frank Perbet

Roberto Cipolla

Atsuto Maki

Oliver Woodford

Minh-Tri Pham

Sam Johnson

Robert Anderson

Vincent Ping Leung Wan

Javier Latorre-Martinez

Riccardo Gherardi

Yasuhiro Taniguchi

Ryuzo Okada

Mayumi Yuasa

Tsukasa Ike

Kentaro Yokoi

Ioannis Stylianou

Langzhou Chen

Kayoko Yanagisawa

Norbert Braunschweiler

Robert Arthur Blokland

Balakrishna Venkata Jagannadha Kolluru

Ranniery Maia

Pablo Alcantarilla

Neil Baker

Nobuhisa Kishikawa

In a method of generating a three dimensional representation of a human body shape from a depth image of a clothed human subject is disclosed. The method comprises identifying at least one sample from a plurality of pre-calculated representative samples, each pre-calculated representative sample comprising a three dimensional representation of a human body shape and a corresponding depth map, by comparing the depth maps of the pre-calculated representative samples with the depth image of the clothed human subject; determining a neighbourhood of the data space of possible depth images of unclothed human body shapes from the depth map of the at least one representative sample; generating a parametric model for the human body shape from a neighbourhood of the data space of human body shapes, the neighbourhood of the data space of human body shapes corresponding to the neighbourhood of the data space of possible depth images of unclothed human body shapes; and generating the three dimensional representation of the human body shape by fitting the parametric model to the depth image of the clothed human subject.

Methods and systems for generating a three dimensional representation of a human body shape

A system for capturing 3D image data of a scene, including three light sources, each configured to emit light at a different wavelength to the other two sources and to illuminate the scene to be captured; a first video camera configured to receive light from the light sources which has been reflected from the scene, to isolate light received from each of the light sources, and to output data relating to the image captured for each of the three light sources; a depth sensor configured to capture depth map data of the scene; and an analysis unit configured to receive data from the first video camera and process the data to obtain data relating to a normal field obtained from the images captured for each of the three light sources, and to combine the normal field data with the depth map data to capture 3D image data of the scene.

Methods and systems for capturing 3D surface geometry

A method of animating a computer generation of a head, the head having a mouth which moves in accordance with speech to be output by the head,

Computer generated head

In one embodiment a method of generating a three dimensional model of a subject is disclosed. The method comprises receiving point cloud data for a subject; receiving user inputs indicating a plurality of cubes, and a grouping of the cubes into a plurality of blocks to form a representation of a class of subjects; generating a first mesh comprising a plurality of quadrilaterals by subdividing patches corresponding to faces of blocks of the plurality of blocks; fitting the first mesh to the point cloud data to generate a fitted mesh; iteratively generating further meshes, each comprising a plurality of quadrilaterals by subdividing patches of the fitted mesh from the previous iteration and fitting the further mesh to the point cloud data; and outputting as the three dimensional model of the subject the iteratively generated fitted mesh.

Method and systems for generating a three dimensional model of a subject by iteratively generating meshes

A method of object recognition and/or registration includes receiving a point cloud, arranging the points of the point cloud into a hierarchical search tree, and determining geometric information of the points located within a region, by identifying a highest level tree nodes where all of descendent leaf nodes are contained within the region and selecting the leaf nodes for the points where no sub-tree is entirely contained within the region, such that the points falling within the region are represented by the smallest number of nodes and performing statistical operations on the nodes representing the points in the region. The geometric information includes descriptors of features in the point cloud. The method further includes comparing the feature descriptors with a database of feature descriptors for a plurality of objects.

Image analysis method by analyzing point cloud using hierarchical search tree

According to one embodiment, a method of generating a three dimensional representation of a subject from a depth image, comprises comparing a depth image of the subject with a plurality of representative images, wherein each representative image is associated with a respective parametric model of a subject; identifying a representative image of the plurality of representative images as a closest representative image to the depth image of the subject; selecting the parametric model associated with the closest representative image to the depth image; and generating a three dimensional representation of the subject by fitting the selected parametric model to the depth image of the subject.

Methods and systems for generating a three dimensional representation of a subject

A method of animating a computer generation of a head and displaying the text of an electronic book, such that the head has a mouth which moves in accordance with the speech of the text of the electronic book to be output by the head and a word or group of words from the text is displayed while simultaneously being mimed by the mouth, wherein input text is divided into a sequence of acoustic units, which are converted to a sequence of image vectors and into a sequence of text display indicators. The sequence of image vectors is outputted as video such that the mouth of said head moves to mime the speech associated with the input text with a selected expression, and the sequence of text display indicators is output as video which is synchronized with the lip movement of the head.

Synthetic audiovisual storyteller

A moving feature is recognized in a video sequence by comparing its movement with a characteristic pattern. Possible trajectories through the video sequence are generated for an object by identifying potential matches of points in pairs of frames of the video sequence. When looking for the characteristic pattern, a number of possible trajectories are analyzed. The possible trajectories may be selected so that they are suitable for analysis. This may include selecting longer trajectories that can be easier to analyze. Thereby where the object being tracked is momentarily behind another object a continuous trajectory is generated.

Method of recognizing a moving feature in a video sequence

A method of comparing two object poses, wherein each object pose is expressed in terms of position, orientation and scale with respect to a common coordinate system, the method comprising: where X is the object pose of one object and Y is the object pose of the other object, s(X) and s(Y) are scalar functions representing the scale of the object poses X and Y respectively, R(X) and R(Y) are matrices expressing the rotation of object poses X and Y respectively, t(X) and t(Y) are vectors expressing the translation of object poses X and Y respectively, and &#x3c3;, &#x3c3;and &#x3c3;are weighting factors for d, dand drespectively.

Image processing method and system

A characteristic motion in a video is identified by determining pairs of moving features that have an indicative relationship between the motions of the two moving features in the pair. For example, the motion of a pedestrian is identified by an indicative relationship between the motions of the pedestrian's feet. This indicative relationship may be that one of the feet moves relative to the surroundings while the other remains stationary.

Monitoring of video images

An object location method includes: analyzing data including plural objects each including plural features, and extracting the features from the data; matching features stored in a database with those extracted from the data, and deriving a prediction of the object, each feature extracted from the data providing a vote for at least one prediction; expressing the prediction to be analyzed in a Hough space, the objects to be analyzed being described by n parameters and each parameter defining a dimension of the Hough space, n is an integer of at least one; providing a constraint by applying a higher weighting to votes which agree with votes from other features than those votes which do not agree with votes from other features; finding local maxima in the Hough space using the weighted votes; and identifying the predictions associated with the local maxima to locate the objects provided in the data.

Object location method and system

According to one embodiment, a method of classifying a feature in a video sequence includes selecting a target region of a frame of the video sequence, where the target region contains the feature; dividing the target region into a plurality cells, calculating histograms of optic flow with the cells comparing the histograms of optic flow for pairs of cells; and assigning the feature to a class based at least in part on the result of the comparison.

Method and system for classifying features in a video sequence

A method dividing an image into plural superpixels of plural pixels of the image. The method calculates an initial set of weights from a measure of similarity between pairs of pixels, from which a resultant set of weights is calculated for pairs of pixels that are less that a threshold distance apart on the image. The calculation calculates a weight for a pair of pixels as the sum over a set of third pixels of the product of initial weight of the first pixel of the pair of pixel with the third pixel and the weight of the third pixel with the second pixel. Each weight is then subjected to a power coefficient operation. The resultant set of weights and the initial set of weights are then compared to check for convergence. If the weights converge, the converged set of weights is used to divide the image into superpixels.

Image processing system and method

An apparatus for a user to interface with a control object apparatus by a posture or a motion of the user's physical part. An image input unit inputs an image including the user's physical part. A gesture recognition unit recognizes the posture or the motion of the user's physical part from the image. A control unit controls the control object apparatus based on an indication corresponding to the posture or the motion. A gesture information display unit displays an exemplary image of the posture or the motion recognized for the user's reference to indicate the control object apparatus.

Growing community of inventors

Cambridge, United Kingdom

Bjorn Stenger