Sony Corporation

Sony Group Corporation

Satoru Kuma

Ohji Nakagami

Tsuyoshi Kato

Koji Yano

Hiroyuki Yasuda

Mitsuhiro Hirabayashi

Ryohei Takahashi

Kao Hayashi

Takuya Kitamura

Koji Kashima

Mitsuru Katsumata

Masashi Eshima

Takumi Tsuru

Tomoya Naganuma

There is provided an image processing device and a method that enables the number of attributes corresponding to a single geometry to be variable in a time direction. An attribute video frame that is a video frame in which a patch obtained by projecting each of a plurality of attributes to a two-dimensional plane for each partial region is arranged is generated, the plurality of attributes corresponding to a single geometry of a point cloud that expresses an object with a three-dimensional shape as a group of points, the generated attribute video frame for each attribute is coded, and attribute information that is information indicating the generated attribute video frames corresponding to the same timing is generated. The present disclosure can be applied to, for example, an image processing device, electronic equipment, an image processing method, a program, or the like.

Image processing device and method

There is provided an image processing device and method capable of suppressing an increase in amount of code. For example, a patch generation parameter used in patch generation processing for generating a patch of an attribute serving as a processing target by referring to an attribute different from the attribute serving as the processing target is derived for some of a plurality of attributes corresponding to single geometry of a point cloud that expresses an object having a three-dimensional shape as a set of points, the derived patch generation parameter is encoded, and an attribute video frame in which a base patch representing a base attribute that is an attribute different from some of the plurality of attributes has been arranged is encoded. The present disclosure can be applied to, for example, an image processing device, an electronic device, an image processing method, or a program.

The present disclosure relates to an image processing apparatus and a method that enable decoding of encoded data of an octree in various processing orders. The octree corresponding to point cloud data is encoded after the context is initialized for each layer of the octree. Further, a breadth-first order or a depth-first order is selected as the decoding order for the encoded data of the octree corresponding to point cloud data, and the encoded data is decoded in the selected decoding order. The present disclosure can be applied to an image processing apparatus, an electronic apparatus, an image processing method, a program, or the like, for example.

Image processing apparatus and method

The present disclosure relates to an information processing device and method capable of suppressing a reduction in coding efficiency. For a point cloud representing a three-dimensional object as a set of points, a coordinate system for geometry data is transformed from a polar coordinate system to a Cartesian coordinate system, a reference relationship indicating a reference destination used to calculate a predictive value of attribute data of a processing target point is set by using the generated geometry data in the Cartesian coordinate system, a prediction residual that is a difference value between the attribute data of the processing target point and the predictive value calculated based on the set reference relationship is calculated, and the calculated prediction residual is encoded. The present disclosure can be applied to, for example, an information processing device, an encoding device, a decoding device, an electronic device, an information processing method, or a program.

Information processing device and method

The present disclosure relates to an information processing apparatus and method capable of reducing a decrease in flexibility in controlling an amount of coding point cloud data. There are formed a reference structure of geometry data in coding of a point cloud that represents a three-dimensional object as a set of points, corrected the geometry data so that a coding amount decreases, derived, on the basis of the formed reference structure, a predicted value of the corrected geometry data, derived a predictive residual that is a difference between the geometry data and the predicted value, and coded the derived predictive residual. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, a coding apparatus, an electronic device, an information processing method, a program, or the like.

Information processing apparatus and method

There is provided an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an information processing method, and a program that facilitate scalable decoding of attribute information. Regarding the attribute information about a point cloud representing a three-dimensional object, a process of classifying the respective points of the point cloud into prediction points that are the points at which difference values between the attribute information and predicted values are left, and reference points that are the points at which the attribute information is referred to during derivation of the predicted values is recursively repeated on the reference points, so that the attribute information is hierarchized. At the time of the hierarchization, the prediction points are selected so that points also exist in voxels of the hierarchical level one level higher than the hierarchical level to which the voxels containing the points of the current hierarchical level belong.

A filter process is performed on point cloud data using a representative value of the point cloud data for each local region obtained by dividing a three-dimensional space. A two-dimensional plane image on which the point cloud data subjected to the filter process is projected is encoded, and a bitstream is generated. The filter process can be performed by, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.

Image processing apparatus and image processing method for suppressing an increase in processing time of a filter process for point cloud data

There is provided an information processing device and method capable of suppressing a reduction in encoding efficiency. When performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, the reference point is set on the basis of a centroid of points. The present disclosure can be applied to, for example, an information processing device, an image processing device, an encoding device, a decoding device, an electronic device, an information processing method, a program, and the like.

There is provided an information processing device, an image processing device, an encoding device, a decoding device, an electronic apparatus, an information processing method, or a program for processing attribute information of each point of a point cloud representing an object in a three-dimensional shape as a set of points, a first level is hierarchized using a first hierarchization method and a second level different from the first level is hierarchized using a second hierarchization method different from the first hierarchization method at the time of performing hierarchization of attribute information by recursively repeating processing of, among points classified as a predictive point or a reference point, deriving a difference value between a predictive value of attribute information of the predictive point derived using attribute information of the reference point and the attribute information of the predictive point for the reference point to perform hierarchization of the attribute information.

There is provided an image processing device and a method that enable partial decoding of 3D data to be performed more easily. Management information of a block as a partial region in a predetermined three-dimensional spatial region including 3D data representing a three-dimensional structure is generated. In addition, a block satisfying a condition specified by a user is selected on the basis of management information of the block as a partial region in a predetermined three-dimensional spatial region including 3D data representing a three-dimensional structure, and coded data of the 3D data within the selected block is decoded. The present disclosure can be applied to, for example, an image processing device, an electronic apparatus, an image processing method, a program, or the like.

There is provided an information processing apparatus and method which enable an increase in a load of decoding processing of coded data of a point cloud to be suppressed. Positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is encoded in an order which causes a decoding result of coded data of the positional information to be output in a processing order of attribute information of the point cloud, and coded data thereof is generated. In addition, coded data of positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is decoded and a decoding result thereof is to be output in a processing order of attribute information of the point cloud. For example, the present disclosure can be applied to an information processing apparatus, an image processing apparatus, a coding apparatus, a decoding apparatus, an electronic device, an information processing method, a program, or the like.

The present disclosure relates to an image processing apparatus and an image processing method each capable of reducing image quality deterioration. A connection component constituted by points that are included in a point group representing a three-dimensional structure, located adjacent to each other, and projected in an identical direction is projected on a two-dimensional plane in a plurality of directions to generate patches in the respective directions. A frame image where the generated patches in the respective directions are arranged is coded. For example, the present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like.

The present disclosure relates to an information processing device and a method capable of suppressing a reduction in encoding efficiency of point cloud data. As for a point cloud representing an object having a three-dimensional shape as a point group, position information of a point to be processed is predicted on the basis of position information of a reference point, position information of a prediction point is generated, a difference between the generated position information of the prediction point and the position information of the point to be processed is derived, the derived difference is encoded, and a bitstream is generated. The present disclosure may be applied to, for example, an information processing device, an electronic device, an information processing method, a program or the like.

The present disclosure relates to image processing apparatus and method that can prevent a reduction in image quality. Geometry data that is a frame image having arranged thereon a projected image obtained by projecting 3D data representing a three-dimensional structure on a two-dimensional plane and includes a special value indicating occupancy map information in a range is generated. The generated geometry data is encoded. Further, the encoded data on the geometry data is decoded, and a depth value indicating a position of the 3D data and the occupancy map information are extracted from the decoded geometry data. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, or a program.

Growing community of inventors

Tokyo, Japan

Satoru Kuma