Canon Kabushiki Kaisha

Canon Europa N.v.

Ulsee Inc.

I2o3d Holdings Limited

Adam Michael Baumberg

Alexander Ralph Lyons

Qi He Hong

Richard Ian Taylor

Aaron William Christopher Kotcheff

Kenichi Nagasawa

Simon Michael Rowe

Takashi Saito

Richard A Kirk

Allan Joseph Davison

Charles Stephen Wiles

Alexandre Percival Dodge

Mark Middlebrook

Koichi Matsumura

Jonathan Mark Sewell

A depth imaging system and a control method thereof are provided. The depth imaging system includes a first imaging device, a second imaging device, a sliding base, a detecting module, an estimating module, a calculating module, and a control module. The first imaging device and the second imaging device are mounted on the sliding base. The detecting module detects a target region of the first image and the second image. The estimating module estimates an initial depth of the target region. The calculating module calculates a baseline corresponding to the initial depth. The control module controls the sliding base to adjust a relative distance between the first imaging device and the second imaging device. The calculating module generates an adjusted baseline according to the adjusted relative distance between the first imaging device and the second imaging device, such that the adjusted baseline is closer to the calculated baseline.

Depth imaging system and method for controlling depth imaging system thereof

Previously our 3DSOM software has solved the problem of extracting the object of interest from the scene by allowing the user to cut-out the object shape in several photographs. This is known as manual 'masking'. However, we wish to avoid this step to make the system as easy to use as possible. For an unskilled user the process needs to be as simple to use as possible. We propose a method of extracting a complete closed model of an object without the user being required to do anything other than capture the shots.

3D capture: object extraction

A method is provided for estimating parameters of an imaging device with respect to an image of a scene said method comprising the steps of locating a target coordinate system in a scene, using an imaging device to capture an image of the scene, and processing the image using the target coordination system as a reference to estimate the parameters of the imaging device with respect to the image, wherein the target coordinate system comprises at least one planer target and wherein the at least one planar target contains a set of identifiable features with known relative positions.

Method of estimating imaging device parameters

This invention introduces, as one aspect, an apparatus for creating three-dimensional object model, comprising photographing means for photographing an object to be modeled for obtaining images to be used for creating the three-dimensional object model, setting means for longitudinally and latitudinally setting a relative position between the object and said photographing means, said setting means being capable of setting the object and said photographing means a plurality of different relative longitudinal and latitudinal positions, and control means for controlling said photographing means and said setting means so that a number of photographs taken from different relative longitudinal positions at a first relative latitudinal position is larger than that taken from different relative longitudinal positions at a second relative latitudinal position, the first relative latitudinal position being closer to a lateral position than the second relative latitudinal position. Accordingly, it becomes possible to minimize the number of photographs for obtaining necessary images to effectively keep a high quality three-dimensional object model, the number of user's manual operations is reduced, and the total photographing time for creating a three-dimensional object model is significantly decreased.

Photographing apparatus, device and method for obtaining images to be used for creating a three-dimensional model

In order to edit texture data for a 3D computer model, an image showing the 3D computer model with the texture data applied thereto is generated from a user-selected viewing direction and displayed to the user. Changes are made to the image data in accordance with user instructions. Corresponding changes are made to the texture data. To preserve texture data that the user did not wish to change and to retain the quality of the original texture data, processing is performed to amend the texture data which corresponds to only the image data that was changed and not texture data which corresponds to image data unchanged by the user. In addition, processing is performed to identify each polygon in the 3D computer model which is at an oblique angle to the viewing direction of the image displayed to the user. The identified polygons are then excluded from subsequent processing so that the texture data therefor is not changed.

Texture map editing

An image processing apparatus is disclosed in which input images are processed to generate texture map data for texture rendering a generated three-dimensional computer model of object(s) appearing in the images. In order to select the portions of the images utilised, confidence data is generated indicative of the extent portions of the surface of a model are visible in each of the images. The images are then combined utilizing this confidence data, where image data representative of different spatial frequencies are blended in different ways utilizing the confidence data.

Image generation method and apparatus

A plurality of texture maps for a 3D computer model of an object are generated by processing images of the object, data defining the computer model, and data defining the relative positions and orientations of the images and computer model. A respective texture map is generated for the viewing position and direction of each image. Each texture map stores texture data for all parts of the computer model which are visible from the associated viewing position and direction and also texture data for all invisible parts of the computer model. Each texture map therefore stores texture data that can be used for rendering accurate images of the 3D computer model over a wide range of viewing positions and directions.

Generation of texture maps for use in 3D computer graphics

Customer computer processing apparatus () are connected to a service apparatus () via the Internet (). Service apparatus () processes requests and payment details from a customer apparatus (), and, in response to a valid payment, sends instructions to the customer apparatus to enable the customer apparatus to control a printer () or a display panel () to print or display a photographic mat (). Service apparatus () retains details of the photographic mat pattern for subsequent use. Images of a subject object on the photographic mat are recorded at different positions and orientations with a camera (). Data defining the images is returned from the customer processing apparatus () to the service apparatus (). The service apparatus processes the image data along with the stored pattern data to identify the photographic mat features in the images and to calculate the position and orientation at which each image was recorded. A three-dimensional computer model of the subject object is then generated using the calculated positions and orientations.

Image processing apparatus

View-dependent texture images and view-independent texture data for a 3D computer model are processed to compress each view-dependent texture image by subtracting the view-dependent data and view-independent data in a common 2D image space to generate a difference image, and compression encoding the difference image. The difference images, 3D computer model and view-independent texture data are transmitted to a second apparatus, where the difference data and view-independent texture data are recombined in a common 2D image space as part of the processing to render an image.

Texture data compression and rendering in 3D computer graphics

A texture map for texturing the polygon mesh of a 3D computer model during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map, and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles are defined so that the area of each triangle is dependent upon the content of texture data to be stored therein. More particularly, triangles required to store texture data with a relatively large amount of detail have a relatively large area and triangles which are required to store texture data with relatively little detail have a relatively small area. In this way, more area is allocated for the storage of detailed texture data, thereby reducing the amount of information which is lost from the texture data during the creation of a texture map.

Generating texture maps for use in 3D computer graphics

A texture map () for texturing a polygon mesh 3D computer model () during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map (), and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles in the polygon mesh are processed to generate a plurality of lists, each list identifying adjacent triangles in the mesh having shapes which can be packed into strips (-) of the texture coordinate map without significant shape distortion. The triangle lists are then packed into the texture coordinate map strips. No padding is defined between triangles in the same list, only between triangles of different lists. Image data is allocated to each triangle.

Apparatus and method for generating texture maps for use in 3D computer graphics

An apparatus is disclosed for generating frequency component image data representative of image information of a plurality of different spatial frequencies of an image of at least part of a subject from a predefined view. A receiver receives a plurality of images comprising image data representative of a subject from a plurality of view points. For each of a plurality of received images, frequency component image data representative of image information of a plurality of different spatial frequencies within images received by the receiver is determined, and projections of the frequency component image data projected to a predefined view are also determined. Visibility data indicative of the relative visibility of portions of the surface of a subject from viewpoints is then determined. Portions of projections of frequency component image data are associated with the visibility data, and the visibility data associated with portions of projections are utilized to determine frequency component image data representative of frequency image information of an image of a subject from a predefined view.

In a computer processing apparatusa 3D computer model comprising a polygon meshrepresenting the visual hull of an objectis generated by processing images of the object recorded at different positions and orientations to back-project the silhouette of the object in each image to give a respective cone which constrains the volume of 3D space occupied by the object. To remove concave and convex artefactsin the polygon meshthe polygon mesh is projected into each image to give a respective reference silhouette for each image. A change is made to at least one edge or vertex in the polygon mesh to give a refined polygon mesh, which is then projected into each image. The resulting silhouette in each image is tested against the corresponding reference silhouette. If the silhouette of the refined polygon mesh is the same as each reference silhouette, to within an allowable tolerance, then the changed edge or vertex is allowed in the polygon mesh, otherwise the polygon mesh is returned to its previous state. This processing to change and test the polygon mesh is carried out a number of times. Artefacts are removed from the polygon mesh because their removal does not make the polygon mesh inconsistent with the reference silhouettes. Parts of the polygon mesh representing actual features of the object are not changed because such a change causes the polygon mesh to become inconsistent with at least one reference silhouette and therefore such a change is rejected.

3D computer model processing apparatus

In an image processing system, a subject objectis placed on top of an object supporton a calibration objecthaving a known pattern of features thereon. Images recorded at different positions and orientations are processed to generate a three-dimensional computer model of the subject object alone or the subject object together with the calibration object. By imaging the subject objecton an object support instead of placing it directly on the calibration object, the user is provided with flexibility in the selection of the pattern and color of the calibration and the selection of the imaging positions and orientations. By providing an object supporthaving a top surface on which the subject objectsits which does not protrude from beneath the base of the subject object, the user is provided with flexibility in the selection of lighting conditions. By imaging the subject objectwith a background screenbehind it, the user is provided with flexibility in the selection of the surface on which the calibration objectis placed for imaging.

Growing community of inventors

Berkshire, United Kingdom

Adam Michael Baumberg