Holition Limited

Russell Freeman

Maria Jose Garcia Sopo

Benjamin Thomas Martin

Tereza Drskova

Maria José Garcia Sopo

A system and method of augmenting image data are described. In one embodiment, the method comprises receiving data of an image captured by a camera, the captured image including a region having a visible feature of an object, storing masking data defining a plurality of masks, each mask defining a respective masked portion of the region of the captured image, sampling pixel values at predefined locations of the captured image data, selecting at least one stored mask based on the sampled pixel values, modifying pixel values in the or each selected masked portion of the region of the captured image based on colourisation parameters, and outputting the captured image with the modified pixel values for display. In other embodiments pixel values of one or more identified regions of a face in a target image are modified based on the augmentation characteristics derived from corresponding identified regions of a face in a source image.

Locating and augmenting object features in images

A computer-implemented method and system are described for locating fingernails of a person's hand in an image. An approximate location of each fingernail in the image is determined. An approximate location of each of a plurality of digit-shape objects in the image is initialized based on the approximate locations of the fingernails, and initially refined based on respective digit-shape object models and corresponding functions. The approximate location of each fingernail sub-shape is further refined based on a respective fingernail model and its corresponding function.

Locating and tracking fingernails in images

A system and method are described for tracking the location and orientation of a user's feet for an augmented reality display. A depth sensor generates a depth map of a scene within the field of view of the depth sensor, the field of view containing at least a portion of the user. A processor is configured to identify a portion of the depth map as a candidate object for foot tracking, determine a central skeleton representation of the identified portion, determine a location of a toe of the user's foot and a location of an ankle of the user's foot, based on the central skeleton representation, and calculate an orientation of the user's foot based on the determine locations of the toe and the ankle.

Foot tracking

There is described an image processing method in which a scene is repeatedly imaged to form a series of input images. For at least a subset of the input images, a color calibration procedure is conducted which populates a foreground color histogram with the frequency of occurrence of color values in a stencil area of the input image, and populates a background color histogram with the frequency of occurrence of color values outside of the stencil portion of the input image. For at least a subset of the input images, a color replacement procedure is conducted which updates the stencil area based on a determination, from the color values of pixels within the input image, of likelihood values representing the likelihood of pixels belonging to an image area of interest, the likelihood value for each color value being determined from a combination of the foreground and background color histograms, replaces the original color values of pixels within the updated stencil area of the input image with replacement color values, and displays the image on which color replacement processing has been conducted. In this way, a stencil area is determined based on foreground/background histogramming, and used both to define an area to which color replacement processing is to be conducted, and also an area for use in further populating the color histograms to calibrate the color replacement processing.

Growing community of inventors

London, United Kingdom

Russell Freeman