Panasonic Intellectual Property Management Co., Ltd.

Panasonic Intellectual Property Corporation of America

Masaki Fukuda

Toru Matsunobu

Satoshi Yoshikawa

Toshiyasu Sugio

Kensho Teranishi

Tatsuya Koyama

Pongsak Lasang

Masanori Kimura

Ukyou Katsura

Keng Liang Loi

Pradit Mittrapiyanuruk

Shunsuke Yasugi

Makoto Kohrin

A calibration method of calibrating, using a processor, parameters of a plurality of imaging apparatuses that capture a common three-dimensional space, includes: obtaining images captured by the plurality of imaging apparatuses; obtaining the parameters of the plurality of imaging apparatuses; for each of the images, generating at least one search window to extract a plurality of feature points of the image using the parameters; for each of the images, extracting the plurality of feature points from an inside of the at least one search window; performing feature point matching between the images using the plurality of feature points; and calibrating the parameters based on a plurality of matching results obtained.

Calibration method and calibration apparatus

A three-dimensional point cloud densification device includes: an obtainer that obtains a plurality of three-dimensional points, each of which indicates a three-dimensional position of at least one object, and auxiliary information for creating a polygon; and a densifier that: identifies the polygon having, as vertices, at least three three-dimensional points among the plurality of three-dimensional points, based on the auxiliary information; and generates a new three-dimensional point inside the polygon.

Three-dimensional point cloud densification device, three-dimensional point cloud densification method, and recording medium

A three-dimensional model generation method includes: detecting a first line from each of a plurality of images of a target area shot to detect a plurality of first lines, the plurality of images being shot from a plurality of viewpoints; excluding, from the plurality of first lines detected, a second line that reaches an edge of an image among the plurality of images; and generating a line segment model which is a three-dimensional model of the target area represented by lines, using a plurality of line segments which are the plurality of first lines from which the second line is excluded.

Three-dimensional model generation method and three-dimensional model generation device

A three-dimensional model generation method executed by an information processing device includes: obtaining images generated by shooting a subject from respective viewpoints; searching for a similar point that is similar to a first point in a first image among the images, from second points in a search area in a second image different from the first image, the search area being provided based on the first point; calculating an accuracy of a search result of the searching, using degrees of similarity between the first point and the respective second points; and generating a three-dimensional model using the search result and the accuracy.

Three-dimensional model generation method and three-dimensional model generation device for calculating an accuracy of a similar point search

A displacement detection method, performed by a computer, includes: obtaining (i) a first three-dimensional (3D) model representing a region at a first timing by 3D points and including first objects and (ii) a second three-dimensional model representing the region at a second timing by 3D points and including second objects, the second timing being different from the first timing; detecting, by use of attribute information of the first objects and the second objects, (i) first 3D points included in the first 3D model and (ii) second 3D points included in the second 3D model and associated with the respective first 3D points; performing alignment of the first 3D model and the second 3D model by use of the first 3D points and the second 3D points; and detecting displacement between the first 3D model and the second 3D model after the alignment.

Displacement detection method, image-capturing instruction method, displacement detection device, and image-capturing instruction device

A three-dimensional reconstruction method of generating a three-dimensional model including a three-dimensional point cloud using images obtained by image capturing devices that capture a common three-dimensional space includes acquiring the images captured at corresponding timings and generating three-dimensional points based on the acquired images. The generating includes generating one or more first three-dimensional points based on a result of a first matching performed on points in two or more first images obtained by two or more first image capturing devices, of the image capturing devices, having fields of view with higher similarity than a predetermined threshold, and generating one or more second three-dimensional points based on a result of a second matching performed on points in two or more second images obtained by two or more second image capturing devices, included in the image capturing devices, having fields of view with lower similarity than the predetermined threshold.

Three-dimensional reconstruction method, three-dimensional reconstruction device, and computer

A three-dimensional model generation method executed by an information processing device includes: obtaining a first three-dimensional model from a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target to thereby generate a first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target; obtaining a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions; and generating a second three-dimensional model by enhancing the definition of the first three-dimensional model using the multi-viewpoint image.

Three-dimensional model generation method, information processing device, and medium

An object amount calculation apparatus includes: a receiver configured to obtain a first three-dimensional model and a second three-dimensional model different from the first three-dimensional model, each of the first three-dimensional model and the second three-dimensional model representing a same space, each of the first three-dimensional model and the second three-dimensional model being constituted with regions having respective attributes; and a processor configured to: align the first three-dimensional model and the second three-dimensional model based on at least one attribute of the first three-dimensional model and the second three-dimensional model; calculate, for each of the attributes, a difference between the first three-dimensional model aligned and the second three-dimensional model aligned; and output (i) a total amount of differences corresponding to two or more attributes among the attributes and (ii) information on the two or more attributes.

Object amount calculation apparatus and object amount calculation method

A shooting method executed by a shooting device includes: shooting first images of a target space; generating a first three-dimensional point cloud of the target space, based on the first images and a first shooting position and a first shooting orientation of each of the first images; and determining a first region of the target space for which generating a second three-dimensional point cloud which is denser than the first three-dimensional point cloud is difficult, using the first three-dimensional point cloud and without generating the second three-dimensional point cloud. The determining includes generating a mesh using the first three-dimensional point cloud, and determining the region other than a second region of the target space for which the mesh is generated.

Shooting method, shooting instruction method, shooting device, and shooting instruction device

A three-dimensional model generation method includes: generating a first three-dimensional model of a predetermined region from first frames; projecting the first three-dimensional model onto at least one second frame; and generating a second three-dimensional model in accordance with first pixels in the at least one second frame onto which the first three-dimensional model is not projected.

A three-dimensional model generation method includes: obtaining map information generated by camera calibration executed by controlling one or more cameras to shoot a subject from a plurality of viewpoints, the map information including three-dimensional points each indicating a position on the subject in a three-dimensional space; obtaining a first image from a first view point and a second image from a second viewpoint; determining a search range in the three-dimensional space, based on the map information, the search range including a first three-dimensional point on the subject, the first three-dimensional point corresponding to a first point in the first image; searching for a similar point that is similar to the first point, in a range in the second image which corresponds to the search range; and generating a three-dimensional model using a search result in the searching.

A method for analyzing a three-dimensional model of an object which includes: obtaining the three-dimensional model generated based on images of the object, the images being imaged by respective cameras from respective viewpoints, the three-dimensional model including three-dimensional points each of which indicating a position of the object; obtaining a camera parameter of one camera among the respective cameras; generating, based on the camera parameter and the three-dimensional model, a depth image indicating a distance between the one camera and the object; generating a foreground image indicating an area in which the object is present in the one image imaged by the one camera; comparing the depth image and the foreground image to determine whether there is a deficiency of a three-dimensional point in the three-dimensional model; and outputting deficiency information if it is determined that there is the deficiency of the three-dimensional point in the three-dimensional model.

Method for analyzing three-dimensional model and device for analyzing three-dimensional model

A three-dimensional model processing method includes: generating, from first images shot by respective cameras at a first time, a first three-dimensional model including: first three-dimensional points indicating a subject at the first time; and first camera parameters indicating positions and orientations of the cameras; generating, from second images shot by the respective cameras at a second time, a second three-dimensional model including: second three-dimensional points indicating the subject at the second time; and second camera parameters indicating positions and orientations of the cameras; detecting a stationary camera among the cameras, whose position and orientation has not changed between the first and second times, or stationary three-dimensional points among the three-dimensional points, whose positions have not changed between the first and second times; and matching world coordinate systems of the first and second three-dimensional models, based on the first camera parameters of the stationary camera or the stationary three-dimensional points detected.

Three-dimensional model processing method and three-dimensional model processing apparatus

A calibration apparatus calibrates parameters of imaging apparatuses which are disposed at different positions and image a common three-dimensional space. The calibration apparatus includes: an obtaining circuit which obtains videos captured by the imaging apparatuses and each including frames; an extraction circuit which extracts feature points from the frames included in the videos, the feature points including first feature points extracted from first frames included in the videos and second feature points extracted from areas containing an image of a moving object in second frames included in the videos and different from the first frames; a matching circuit which performs matching using the feature points, the matching including matching between the first feature points and matching between the second feature points; and a calibration circuit which calculates parameters of the imaging apparatuses based on first matching results obtained through the matching by the matching circuit.

Growing community of inventors

Osaka, Japan

Masaki Fukuda