Sony Interactive Entertainment Inc.

Sony Corporation

Sony Computer Entertainment Inc.

Hirofumi Okamoto

Tetsugo Inada

Akio Ohba

Hiroyuki Segawa

Atsushi Kimura

Shoichi Ikenoue

Masaki Uchida

Tatsuo Tsuchie

Daisuke Tahara

Takashi Kohashi

Takashi Itou

Hidehiko Ogasawara

Masanori Takano

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the image of the user guide represents a state of the real space in which the user is physically located, as viewed obliquely.

Information processing apparatus and user guide presentation method

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the generating and outputting data of the image of the user guide includes determining whether to display the user guide in response to certain criteria.

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the generating and outputting data of the image of the user guide includes determining whether to display the user guide in response to one of: (i) a user operation, and (ii) regardless of the user operation.

As a user guide, the state of overlooking a real space including an imaging device and a user is presented by one of two images: an image in reference to the position of the imaging device, or an image in reference to the user's direction. In both images, a rectangle indicative of the imaging device and a circle representative of the user are presented in a manner reflecting the actual positional relations and directions involved. Also presented are an area denoting a play area in the horizontal direction determined by a camera angle of view for example, and an arrow pointing to the direction in which the user is to move.

[Object] To perform more stable and highly accurate attitude estimation. [Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.

Image processing device and method

An information processing device causes an information processing section to perform information processing of a game for example, based on a user's operation received by an input information acquiring section and on images acquired by a stereo camera and obtained through an acquired image obtaining section. The information processing device causes an output data generating section to output the result of the information processing to a display device. At this point, a tracking processing section detects corresponding marker images from stereoscopic images and, based on a parallax therebetween, obtains position information about a target object. In accordance with vertical position misalignment between the detected marker images, a calibration determining section determines whether camera calibration is needed and requests the output data generating section to notify the user of the determined need.

Information processing device and information processing method for stereoscopic image calibration

An image acquisition block of an information processing apparatus acquires stereo images taken by a first camera and a second camera that make up an imaging apparatus. An input information acquisition block accepts a user manipulation. A first positional information acquisition block of a positional information generation block identifies an approximate position of an object to be imaged through predetermined means. A second positional information acquisition block determines an estimated distance range of a target on the basis of the identified approximate position of the object to be imaged, detects corresponding points by executing block matching on stereo images thorough only a search range corresponding to the determined estimated distance range, and obtains a position of the target with high resolution and accuracy. An output information generation block generates output data on the basis of the position of that target and outputs the generated output data.

Information processing apparatus and information processing method

Disclosed herein is an image processing apparatus including: a priority degree setting section configured to set a degree of priority for each of surrounding regions of a plurality of people detected from an input image; and a pose estimation section configured to estimate poses of human body models for human body regions extracted from the input image one after another, on the basis of the surrounding regions of one or more of the people selected using the degrees of priority set by the priority degree setting section.

Image processing apparatus and image processing method

Disclosed herein is an image processing device including a background model creation section adapted to create a plurality of background models based on statistical distribution of a plurality of image frame sets, the image frame sets differing in length of time, and each of the image frame sets including a plurality of input frames; and a background image creation section adapted to create a background image by referring to the plurality of background models.

Image processing device and method for creating a background image

A detection area is set in a three-dimensional space in which a subject exists. When an actual hand enters the detection area, coordinate points (white and black dots) represented by pixels making up a silhouette of the hand in a depth image enter the detection area. In the detection area, a reference vector is set that shows the direction which the hand should face relative to the shoulder as a reference point. Then, an inner product between two vectors, a vector from the reference point to each of coordinate points and the reference vector, is calculated, followed by comparison between the inner products. Positions of coordinate points whose inner products are ranked high are acquired as the position of tips of the hand.

Information processor and information processing method

An information processor includes: a similarity data generation portion generating similarity data that represents the calculated similarity to the image in the reference block in association with a position within the search range; a result evaluation portion detecting a position with a maximum similarity value for each piece of the similarity data and screening the detection result by making a given evaluation of the similarity; a depth image generation portion finding a parallax for each of the reference blocks using the detection result validated as a result of screening, calculating a position of a subject in a depth direction on a basis of the parallax, and generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.

Information processor, information processing method, and computer program

An information processor includes: a similarity data generation portion generating, for a position within the search range, similarity data that represents the calculated similarity to the image in the reference block in association with the position within the search range; a similarity correction portion smoothing the similarity data in a direction of space on a basis of similarity data; a result evaluation portion detecting a position with a maximum similarity value in each piece of the smoothed similarity data; a depth image generation portion generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.

An imaging device includes a first camera and a second camera and shoots the same object under different shooting conditions. A shot-image data acquirer of an image analyzer acquires data of two images simultaneously shot from the imaging device. A correcting section aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section switches and generates a correction table to be used according to the function implemented by the information processing device. A correction table storage stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator performs stereo matching by using the two images and generates a depth image.

Information processing device, information processing system, and information processing method

An image acquisition section of an information processor acquires stereo images from an imaging device. An input information acquisition section acquires an instruction input from a user. A depth image acquisition portion of a position information generation section generates a depth image representing a position distribution of subjects existing in the field of view of the imaging device in the depth direction using stereo images. A matching portion adjusts the size of a reference template image in accordance with the position of each of the subjects in the depth direction represented by the depth image first, then performs template matching on the depth image, thus identifying the position of a target having a given shape and size in the three-dimensional space. An output information generation section generates output information by performing necessary processes based on the target position.

Image processor and image processing method

An image storage sectionstores shot image data with a plurality of resolutions transmitted from an imaging device. Depth imageswith a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S). Next, template matching is performed using a reference template imagethat represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section(S). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (Sand S).

Growing community of inventors

Tokyo, Japan

Hirofumi Okamoto