Sony Corporation

Sony Interactive Entertainment Inc.

Sony Group Corporation

Nobuaki Izumi

Naofumi Yanagihara

Junichi Tsukamoto

Shinichi Fukushima

Yuka Oikawa

Yoichi Yagasaki

Mitsuhiro Hirabayashi

Mitsuru Katsumata

Hiroshi Oryoji

Yuichi Araki

Toshiya Hamada

Shinji Watanabe

Yuji Ando

Takayuki Shinohara

Yuichi Hasegawa

Junichiro Enoki

Yuka Kiyama

Kiminori Sugisaki

Yukara Ikemiya

Jason Fischl

There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like.

Video reproduction apparatus, reproduction method, and program

An information processing apparatus that includes a receiving unit that receives a request including load information regarding a load and a sending unit that sends a data set in accordance with the request. The data set includes three-dimensional shape data, and left-eye texture data and right-eye texture data. The three-dimensional shape data has a vertex count corresponding to the load information. The left-eye texture data and the right-eye texture data correspond to the three-dimensional shape data.

Information processing apparatus and information processing method

There is provided a playback apparatus and method, and generation apparatus and method capable of performing enlargement/reduction display of an image while preventing an occurrence of motion sickness. In a case where enlargement/reduction of omnidirectional image is selected, the playback apparatus includes a vertex data transformer that generates a 3D model for enlargement/reduction. The present disclosure can be applied, for example, to a playback apparatus and the like that generates an image obtained by perspective-projecting an omnidirectional image as a display image according to the viewer/listener's line-of-sight direction.

Playback apparatus and method, and generation apparatus and method

The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image at a first viewpoint and a second layer image including a texture image and a depth image at a second viewpoint different from the first viewpoint in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied, for example, to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.

Image processing apparatus and image processing method

The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r' of a distance r&#x2032; between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.

The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.

The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image and a second layer image including a texture image and a depth image in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied to, for example, a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.

There is provided an image processing device and an image processing method for instantaneously displaying an image of a user's field of view. An encoder encodes a celestial sphere image of a cube formed by images of multiple planes generated from omnidirectional images, the encoding being performed plane by plane at a high resolution, to generate a high-resolution encoded stream corresponding to each of the planes. The encoder further encodes, at a low resolution, the celestial sphere image to generate a low-resolution encoded stream. The present disclosure may be applied, for example, to image display systems that generate a celestial sphere image so as to display an image of the user's field of view derived therefrom.

Image processing device and image processing method for encoding/decoding omnidirectional images at different resolutions

There is provided an image processing apparatus and an image processing method that can follow a fast movement of a virtual point to change a high-precision image. A position correction unit corrects a three-dimensional position of a point of a boundary of an occlusion area among a plurality of points, the three-dimensional position being included in three-dimensional data including three-dimensional positions and color information of the plurality of points, the three-dimensional data being generated from color image data and depth image data from a predetermined viewpoint. The present disclosure can be applied to, for example, an image processing apparatus or the like that generates color image data from a virtual viewpoint on the basis of color image data and depth image data from a predetermined viewpoint.

There is provided a generation apparatus, a generation method, a reproduction apparatus, and a reproduction method by which a display image generated by use of an omnidirectional image is made approximately uniform in image quality in all visual line directions. A down-conversion part down-converts an omnidirectional image. A perspective projection part generates multiple images by projecting on multiple two-dimensional planes the omnidirectional image mapped onto a 3D model. This disclosure may be applied, for example, to generation apparatuses that generate an omnidirectional image from captured images in six directions so as to generate low- and high-resolution streams of the omnidirectional image.

Generation apparatus, generation method, reproduction apparatus, and reproduction method

There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

A sound source setting section and a listening setting section are each configured to have a parameter setting section, a display section, and an arrangement relocation section on a placing surface of a placing table in real space, the arrangement relocation section allowing the source setting and listening sections to relocate on the placing surface. A reflecting member to which a reflecting characteristic is assigned is configured to be placeable on the placing table. A mixing process section performs a mixing process and also generates an image at the position, in a virtual space, of the sound source setting section relative to the listening setting section, the image having a texture indicative of a sound source assigned to the sound source setting section. Sound mixing with respect to a free listening point is thus performed easily.

Information processing apparatus, information processing method, and program

An image processing device and an image processing method for generating a celestial sphere image are provided such that the pixels near the poles of the sphere are kept from increasing in density when the image is mapped to the sphere surface. An encoder encodes, with respect to an omnidirectional image generated by equidistant cylindrical projection to include a top image, a middle image, and a bottom image in a vertical direction, the middle image into an encoded stream at a high resolution, and the top image and the bottom image into encoded streams at a resolution lower than the high resolution in systems including image display systems.

Image processing device and image processing method for encoding/decoding omnidirectional image divided vertically

There is provided an encoder that enables an image of a field-of-view range of a user to be displayed immediately. The encoder encodes, for a pair of opposite surfaces among a plurality of surfaces of a model for an omnidirectional image, a first composite image obtained by combining an omnidirectional image of a first surface of a high resolution and an omnidirectional image of a second surface of a resolution lower than the high resolution and a second composite image obtained by combining an omnidirectional image of the second surface of the high resolution and an omnidirectional image of the first surface of a low resolution. For example, the present disclosure can be applied to an image display system or the like.

Growing community of inventors

Kanagawa, Japan

Nobuaki Izumi