Sony Corporation

Sony Mobile Communications Inc.

Sony Group Corporation

Sony Mobile Communications Ab

Daniel Linåker

Jonas Gustavsson

Johannes Elg

Fredrik Mattisson

Mats Wernersson

Fredrik Olofsson

Henrik Heringslack

Mattias Walls

Ola Karl Thörn

Lars Novak

Francesco Michielin

Pal Szasz

Henrik Vallgren

Anders Wikander

Bo-Erik Månsson

Allan Johansson

Henrik Tuszynski

Ola Thörn

Methods of modeling a three-dimensional (3D) object are provided. A method of modeling a 3D object includes generating a 3D model of at least a portion of the 3D object based on data from a plurality of two-dimensional (2D) images. Moreover, the method includes scaling the 3D model by estimating a distance to the 3D object. Related devices and computer program products are also provided.

3D object modeling using scale parameters and estimated distance

Methods of determining whether an environment is suitable or acceptable for performing a three-dimensional (3D) scan are provided. The methods may include performing one or more checks on captured image data of the environment, wherein performing each of the one or more checks comprises determining whether the environment satisfies a respective criterion. The method may further include determining that the environment is suitable or unsuitable for performing the 3D scan based on a result of each performed check. Determining that the environment is suitable for performing the 3D scan may include determining that the environment satisfies each of the respective criteria of the performed one or more checks. Determining that the environment is unsuitable for performing the 3D scan may include determining that the environment does not satisfy at least one criterion of the performed one or more checks. Related devices and computer program products are also provided.

Methods, devices, and computer program products for checking environment acceptability for 3D scanning

A method for determining the scale of a digital 3D model may include receiving, corresponding to a plurality of images, a respective plurality of first distances between the camera and the object in the environment and calculating, using a simultaneous localization and mapping (SLAM) algorithm, a plurality of second distances between the camera and the object in the 3D model of the environment. The method may include calculating a plurality of ratios corresponding to the plurality of images based on respective ones of the plurality of first distances and respective ones of the second distances and determining a scale of the 3D model based on the plurality of ratios. The method may include creating a scaled digital 3D model based on the 3 D model and the determined scale of the 3 D model. Distances and sizes in the scaled 3D model may correspond to actual distances and sizes of the environment.

Simultaneous localization and mapping (SLAM) devices with scale determination and methods of operating the same

The invention is directed to exposure control in a camera. An exemplary method comprises determining depth information associated with a portion of an image frame; obtaining exposure data associated with the portion of the image frame; and controlling an amount of exposure for the portion of the image frame based on the depth information and the exposure data.

Exposure control using depth information

The invention is directed to systems, methods and computer program products for capturing an image using an array camera. A method comprises determining an application associated with capturing an image using an array camera, wherein the array camera comprises a first sensor and at least one second sensor, wherein the first sensor comprises a red filter, a green filter, and a blue filter, and wherein each second sensor comprises a red filter, a green filter, or a blue filter; determining whether the application requires the image to have a first resolution equal to or greater than a predetermined resolution; determining whether the application requires depth information associated with the image; and in response to determining the application does not require the image to have the first resolution and does not require depth information, activating the first sensor, and capturing the image using the first sensor.

Array camera design with dedicated Bayer camera

The invention is directed to determining compensation distance for capturing an image in a zoom mode using a camera. An exemplary method comprises determining the camera is in a non-zoom mode; receiving first depth information associated with an object in the image when the camera is in the non-zoom mode; receiving first angle information associated with the object in the image when the camera is in the non-zoom mode; switching from the non-zoom mode to a zoom mode; receiving second angle information associated with the object in the image when the camera is in the zoom mode; determining a compensation distance for capturing the image of the object in the zoom mode based on the first depth information, the first angle information, and the second angle information; and generate an image based on the compensated distance.

Perspective change using depth information

On the basis of a first configuration of one or more imaging sensors, first video data is captured at a first frame rate and a first resolution and second video data is captured at a second frame rate and a second resolution. The second frame rate is higher than the first frame rate and the second resolution is lower than the first resolution. Further, an amount of motion is detected in the captured second video data. On the basis of the detected amount of motion, the at least one imaging sensor is switched to a second configuration. On the basis of the second configuration, third video data is captured at a third frame rate and a third resolution. The third frame rate is higher than the first frame rate and the third resolution is higher than the second resolution.

Sensor configuration switching for adaptation of video capturing frame rate

A method and apparatus for recording a composite image from a lens array are disclosed. A first composite image is recorded using a first lens providing imaging data in a first color, a second lens providing imaging data in a second color, and a third lens providing imaging data in a third color, wherein the first, second, and third colors are different colors. A second composite image is recorded using the first lens, a fourth lens providing imaging data in the second color, and a fifth lens providing imaging data in the third color. The first and second composite images are compared to identify color fringed areas. Based on the relative size and location of the color fringed areas in the first and second composite images, a de-fringing algorithm is applied to at least one of the composite images to mitigate the color fringing in the color fringed areas.

Method and apparatus for reducing color fringing in composite images

Aspects of the disclosed technology relate to an imaging system and method in which an array camera is employed along with an image processor to make use of parallax convergence differences in color and luminance between different cameras or groups of cameras within an array camera to provide improved super resolution performance.

Array camera imaging system and method

Aspects of the disclosed technology relate to an imaging system and method in which an array camera is employed along with an image processor to make use of parallax convergence differences between different cameras or groups of cameras within an array camera to provide improved super resolution performance.

Growing community of inventors

Lund, Sweden

Daniel Linåker