Sony Corporation

Sony Group Corporation

Sony Interactive Entertainment Inc.

Daisuke Tahara

Kazuhiro Shimauchi

Atsushi Kimura

Hiroshi Ikeda

Yuji Wada

Nobuho Ikeda

Akio Ohba

Hiroyuki Segawa

Tetsugo Inada

Hirofumi Okamoto

Takashi Kohashi

Nobuhiro Tsunashima

Yuki Ono

Yuta Nakao

Masakazu Ebihara

Alexander Berestov

Cheng-Yi Liu

An information processing apparatus, method, and non-transitory computer-readable storage medium that estimate a three-dimensional skeleton based on images captured from a plurality of viewpoints, and generate a skeleton model by modeling the three-dimensional skeleton. The information processing apparatus, method, and non-transitory computer-readable storage medium further model a joint in a spherical shape or a bone in a cylindrical shape in the three-dimensional skeleton, and set a radius of a sphere of the joint or a radius of a cylinder of the bone according to a distance between any one of the plurality of viewpoints or a virtual viewpoint and the joint or the bone.

Information processing apparatus, information processing method, and computer-readable storage medium

A novel multiple camera calibration algorithm uses human joint points for matched key points. A recent machine-learning based human joint detector provides joint positions with labels (e.g. left wrist, right knee, and others). In single person situation, it directly provides matched key points between multiple cameras. Thus, the algorithm does not suffer a key-point matching problem, even in a very sparse camera configuration, which is challenging in the traditional image feature-based method. This algorithm provides easy setup for a multiple camera configuration for marker-less pose estimation.

Camera calibration method using human joint points

In an image including a continuous visual field of 360 degrees, such as a celestial sphere image, in a case where a partial region is displayed as an output target region, transition from a certain output target region to the other output target region is realized smoothly and with natural feeling, without having visually uncomfortable feeling. For this reason, a transition source output target region and a transition destination output target region are specified, in an output target region which is a partial region of the entire image, which is an image having a continuous visual field of 360 degrees in at least one direction. Then, a visual field transition path from the specified transition source output target region to the specified transition destination output target region is automatically determined.

Information processing device, information processing method, and program

An image pickup apparatus, image processing apparatus and corresponding program and method are disclosed. In one example, a second captured image acquired from another apparatus is aligned with a first captured image. Image stabilization is carried out in response to a positional relation between the captured images. For example, when overlapping between the captured images is equal to or smaller than an image stabilization limitation threshold value, the image stabilization is stopped or a correction range is limited for at least one of the captured images. When the amount of overlapping is larger than the image stabilization limitation threshold value, the image stabilization for both of the captured images is carried out without limitation. The captured images are aligned with each other by using the captured image with limited image stabilization, or both captured images where stabilization is carried out without limitation, thereby producing a panoramic image.

Image processing apparatus, image processing method, program, and image pickup system

Provided is a position detection unit configured to detect position information of a first imaging device and a second imaging device on the basis of corresponding characteristic points from a first characteristic point detected as a physical characteristic point regarding a subject imaged by the first imaging device, and a second characteristic point detected as a physical characteristic point regarding the subject imaged by the second imaging device. The present technology can be applied to an information processing apparatus that specifies positions of a plurality of imaging devices.

Apparatus, method, and program with verification of detected position information using additional physical characteristic points

A system and method for calibration of cameras on Unmanned Aerial Vehicles (UAVs) is provided. The system receives a set of anchor images of a human subject from a set of anchor cameras and a group of images of the human subject from multiple viewpoints in three-dimensional (3D) space from a group of cameras on a group of UAVs. The system determines a first set of two-dimensional (2D) positions of human joints from the set of anchor images and a second set of 2D positions of the human joints from the group of images. The system computes, as 3D key-points, 3D positions of the human joints based on triangulation using the first set of 2D positions and determines a 2D re-projection error between the 3D key-points and the second set of 2D positions. Thereafter, by minimizing the 2D re-projection error, the system calibrates each camera of the group of cameras.

Calibration of cameras on unmanned aerial vehicles using human joints

[Object] To perform more stable and highly accurate attitude estimation. [Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.

Image processing device and method

[Object] To select an effect process appropriately according to a feature of an image. [Solution] Provided is an image processing device including a flow vector detection unit configured to detect flow vectors of pixels in an input image, and an effect selection unit configured to select a process of effect to the input image, on the basis of a pattern of the flow vectors.

Image processing device, image processing method, and program

[Object] To support a user such that the user can easily adjust installation states of a plurality of imaging devices. [Solution] Provided is an information processing device including an adjustment instruction specification unit configured to specify an instruction regarding adjustment by extracting or arranging elements of the adjustment in accordance with a level of priority of each of the elements for shifting current installation states of a plurality of imaging devices toward appropriate installation states of the plurality of imaging devices.

A system for marker-based pose estimation includes display of a 3D human body model on a display screen. The system includes circuitry that assigns a weight to each marker of a plurality of markers distributed on a human body. The circuitry determines an objective function for each joint of the plurality of joints based on a set of descendant markers. The circuitry updates each parameter of a first plurality of parameters that defines a first pose of the human body, based on a change in a value of the objective function. The circuitry determines a second plurality of parameters that defines a second pose of the human body based on the updated first plurality of parameters. The circuitry controls movement of the rigged 3D human body model on the display screen in synchronization with the second pose.

Marker-based pose estimation

Disclosed herein is an image processing apparatus including: a priority degree setting section configured to set a degree of priority for each of surrounding regions of a plurality of people detected from an input image; and a pose estimation section configured to estimate poses of human body models for human body regions extracted from the input image one after another, on the basis of the surrounding regions of one or more of the people selected using the degrees of priority set by the priority degree setting section.

Image processing apparatus and image processing method

Disclosed herein is an image processing device including a background model creation section adapted to create a plurality of background models based on statistical distribution of a plurality of image frame sets, the image frame sets differing in length of time, and each of the image frame sets including a plurality of input frames; and a background image creation section adapted to create a background image by referring to the plurality of background models.

Growing community of inventors

Tokyo, Japan

Daisuke Tahara