Sony Corporation

Sony Group Corporation

Shunichi Homma

Jianing Wu

Yoshiaki Iwai

Masaki Fukuchi

Akihiko Kaino

Tatsuki Kashitani

Shinichiro Abe

Takaaki Kato

Takayuki Yoshigahara

Masashi Eshima

Kenichirou Ooi

Shingo Tsurumi

Kenichiro Oi

Akira Nakamura

Daiki Yamanaka

Yuya Hanai

Yuya Yamaguchi

There is provided an information processing system to cause a performer who appears in content distributed in real time to give a performance according to a viewer's reaction in a remote location. The information processing system includes a control unit. The control unit acquires, from a terminal of a viewer on which content obtained by shooting a performance of a performer is being reproduced via a network in real time, a gaze parameter indicating a gaze of the viewer in a coordinate system of a space in which the viewer is present, the gaze parameter being acquired together with a viewer identification information for identifying the viewer. Moreover, the control unit converts the acquired gaze parameter to a gaze parameter indicating a virtual gaze of the viewer in a coordinate system of a space in which the performer is present. Furthermore, the control unit outputs, on the basis of the converted gaze parameter, gaze information indicating the virtual gaze of the viewer to an output device in the space in which the performer is present.

Information processing system, information processing method, and program

An information processing system includes a controller. The controller acquires viewing state information together with viewer identification information from terminals of a plurality of viewers that are reproducing content in which a performance of a performer is imaged via a network in real time, the viewing state information indicating a line of sight or a position of each viewer in a coordinate system of a space where the viewer is present, the viewer identification information identifying the viewer. Further, the controller adds an effect to the content for each of the viewers on the basis of the acquired viewing state information.

There is provided an information processing device including an image acquisition unit that acquires a captured image of a real space from an image capture device, a setting unit that sets, in association with the real space, an augmented reality space that virtually augments the real space depicted in the captured image, the augmented reality space differing according to related information that relates to the captured image, and a control unit that causes an image of a virtual object placed for each user within the augmented reality space to be displayed on a screen.

Information processing device, client device, information processing method, and program

There is provided an information processing apparatus and an information processing method capable of performing position estimation of a controller corresponding to a wearable device having an inside-out type. The information processing apparatus includes a user-position estimating unit that recognizes, based on a first captured image that is captured by a first image capturing unit provided to a wearable device mounted on a user, peripheral environment information of the user to execute position estimation of the user in a real space and a controller-position estimating unit that executes, based on a second captured image captured by a second image capturing unit that is provided to a controller being operated by the user, position estimation of the controller with reference to the recognized environment information.

Information processing apparatus and information processing method

An information processing apparatus according to the present technology includes a control section. The control section includes a determination section and a model data generation section. The determination section determines whether or not a predetermined modeling condition is satisfied on the basis of sensor data acquired along with a movement of a moving object. In a case where it is determined by the determination section that the predetermined modeling condition is satisfied, the model data generation section generates model data relating to the floor using the sensor data.

Information processing apparatus, information processing method, and floor modeling system

There is provided an information processing apparatus to bring a three-dimensional model generated in accordance with observation information, closer to a real object. The information processing apparatus includes: a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.

Information processing apparatus, information processing method, and storage medium

Provided is an information processing apparatus including an estimating unit that estimates at least one of a location or an attitude of a predetermined chassis in real space on the basis of a first image captured by a first image capturing unit among a plurality of image capturing units held in the chassis. The information processing apparatus further includes a verifying unit that verifies a likelihood of the estimation result on the basis of a second image captured by a second image capturing unit having an optical axis different from an optical axis of the first image capturing unit among the plurality of image capturing units.

There is provided an information processing apparatus to achieve both the stabilization of estimation of the distance to a target physical body and the suppression of power consumption. The information processing apparatus includes: a first estimation unit configured to estimate a distance between a prescribed visual point and a physical body in a real space on the basis of result of detection of light that is sent from a prescribed light sending unit toward the physical body and is reflected at the physical body; a second estimation unit configured to estimate at least either one of a position or an attitude in the real space of the prescribed visual point on the basis of result of estimation of the distance; and a control unit configured to control the light sent from the light sending unit in accordance with a situation regarding estimation of at least either one of the position or the attitude.

Information processing apparatus, information processing method, and program

An apparatus comprising a memory storing instructions is provided. The apparatus includes a control unit for executing the instructions to send signals to display, for a user, a first virtual image superimposed onto a representation of real space. The control unit further executes instructions to send signals to identify a potential source of interest for the user, the potential source of interest being outside of a user focus area in the representation of real space. The control unit further executes instructions to send signals to notify the user of the potential source of interest.

Information processing to notify potential source of interest to user

The present disclosure relates to an information processing device, an information processing method, and a program capable of performing continuous estimation of a self-position. An information processing device according to an aspect of the present disclosure includes: a main imaging unit that includes a stereo camera mounted on a moving body, and captures moving images at a predetermined frame rate to output a pair of stereo main images as time-series images; a plurality of sub imaging units each of which is so mounted on the moving body as to have an imaging direction different from an imaging direction of the main imaging unit, and captures moving images at a predetermined frame rate; and a final pose determination unit that estimates a pose of the moving body on the basis of the pair of stereo main images captured by the main imaging unit, and sub images captured by the sub imaging units. For example, the present disclosure is applicable to a self-position sensor for in-vehicle use.

Information processing device, information processing method, and program

There is provided an information processing apparatus to present, to a user, an additional image, which is a virtual object, in a manner superimposed on a real-space image at a position corresponding to a viewpoint in the real space, the image processing apparatus including a processing unit configured to display an additional image corresponding to a viewpoint of a user in the real world, and guide the user to the vicinity of the viewpoint in the real world where the additional image has been acquired.

Information processing apparatus and information processing method for guiding a user to a vicinity of a viewpoint

There is provided an information processing device including an image acquisition unit that acquires a captured image of a real space from an image capture device, a setting unit that sets, in association with the real space, an augmented reality space that virtually augments the real space depicted in the captured image, and a control unit that determines a target position for an action executed within the augmented reality space, on a basis of a positional relationship between an object within the augmented reality space and an optical axis of the image capture device.

There is provided an information processing apparatus that self position estimation with high robustness is possible, the information processing apparatus including: a tracking unit, a region estimation unit, and an estimation processing unit. The tracking unit that acquires an image captured by an image capture unit disposed at a moving object, and corresponds characteristic points included in the image captured before movement and the image captured after the movement, the moving object moving accompanying a rotation motion. The region estimation unit that acquires information about the movement, and estimates regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information. The estimation processing unit that performs self position estimation of the moving object using the characteristic points within the regions corresponded by the tracking unit.

There is provided an information processing device including an image acquisition unit configured to acquire an input image of a real space captured with an imaging device, a user interface unit configured to display the input image on a screen of a display device and detect a designated position designated by a user on the screen, a computation unit configured to compute a three-dimensional position of a virtual object in an augmented reality space from the designated position detected by the user interface unit, and an authoring unit configured to associate the three-dimensional position of the virtual object computed by the computation unit with the virtual object to store the three-dimensional position in a storage medium.

Growing community of inventors

Tokyo, Japan

Shunichi Homma