The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 25, 2023

Filed:

Aug. 31, 2020
Applicant:

Sony Interactive Entertainment Inc., Tokyo, JP;

Inventors:

Nigel John Williams, London, GB;

Andrew William Walker, London, GB;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 7/80 (2017.01); G06T 7/593 (2017.01); H04N 13/106 (2018.01); G06F 1/03 (2006.01); G06T 5/50 (2006.01); H04N 13/111 (2018.01); H04N 13/00 (2018.01);
U.S. Cl.
CPC ...
G06T 7/80 (2017.01); G06F 1/03 (2013.01); G06T 5/50 (2013.01); G06T 7/593 (2017.01); H04N 13/106 (2018.05); H04N 13/111 (2018.05); G06T 2207/20021 (2013.01); G06T 2207/20216 (2013.01); H04N 2013/0081 (2013.01);
Abstract

A method of generating a 3D reconstruction of a scene, the scene comprising a plurality of cameras positioned around the scene, comprises: obtaining the extrinsics and intrinsics of a virtual camera within a scene; accessing a data structure so as to determine a camera pair that is to be used in reconstructing the scene from the viewpoint of the virtual camera; wherein the data structure defines a voxel representation of the scene, the voxel representation comprising a plurality of voxels, at least some of the voxel surfaces being associated with respective camera pair identifiers; wherein each camera pair identifier associated with a respective voxel surface corresponds to a camera pair that has been identified as being suitable for obtaining depth data for the part of the scene within that voxel and for which the averaged pose of the camera pair is oriented towards the voxel surface; identifying, based on the obtained extrinsics and intrinsics of the virtual camera, at least one voxel that is within the field of view of the virtual camera and a corresponding voxel surface that is oriented towards the virtual camera; identifying, based on the accessed data structure, at least one camera pair that is suitable for reconstructing the scene from the viewpoint of the virtual camera, and generating a reconstruction of the scene from the viewpoint of the virtual camera based on the images captured by the cameras in the identified at least one camera pair.


Find Patent Forward Citations

Loading…