Sony Interactive Entertainment Inc.

Sahin Serdar Kocdemir

Andrew James Bigos

Andrew William Walker

Rosario Leonardi

Philip Cockram

Daniel Goldman

Anthony William Dann

Oliver Richard Smith

A data processing apparatus includes: an input unit configured to receive data corresponding to at least part of a mesh, where the at least part of the mesh includes a plurality of vertices, where each vertex corresponds to a location within a virtual space, and a plurality of polygons, where each polygon includes a perimeter comprising three or more lines, where each of the three or more lines intersects two of the plurality of vertices; a generating unit configured to, in a first phase, generate, based on the received data, two or more seed points, where each seed point corresponds to a location within the virtual space, and in a second phase, where the second phase is different from the first phase, generate two or more meshlets, where each meshlet includes a subset of the at least part of the mesh, where each meshlet is generated in dependence upon the location of a respective one of the generated seed points; and an output unit configured to output data corresponding to one or more of the generated meshlets.

Data processing apparatus and method

A data processing apparatus includes circuitry configured to: receive an image of a user in an environment; determine a region of the environment in the image in which motion of the user is expected, the motion of the user being associated with interactive content experienced by the user; identify one or more attributes of a detected object in the image, a portion of the detected object being within the determined region of the environment; determine a predetermined process associated with the one or more identified attributes; and perform the predetermined process.

An image rendering method for rendering a pixel at a viewpoint includes: for a first element of a virtual scene, having a predetermined surface at a position within that scene, evaluating whether to render a pixel corresponding to the first element using a machine learning system having been trained to output a value representative of the lighting of the predetermined surface at the position, or using an alternative rendering approach, and rendering the pixel according to which of the machine learning system and the alternative rendering approach are chosen.

Image rendering method and apparatus

An image rendering method for rendering a pixel at a viewpoint includes: for a first element of a virtual scene, having a predetermined surface at a position within that scene, evaluating whether to render a pixel corresponding to the first element using at least a first machine learning system having been trained to generate an illuminance output representative of the lighting of the predetermined surface at the position, or using an alternative rendering approach, and rendering the pixel according to which of the at least first machine learning system and the alternative rendering approach are chosen in the evaluating step; where the evaluating step comprises obtaining a confidence value from the at least first machine learning system indicative of the accuracy of the illuminance output, the machine learning system having been trained to generate the confidence value in conjunction with the illuminance output, and the rendering step comprises using the alternative rendering approach if the confidence value does not satisfy a predetermined threshold value.

A system for generating one or more images for display, the system comprising an image obtaining unit operable to obtain an image of a user's face, a geometry information unit operable to identify geometry information for the user's face using the obtained image, a lighting information unit operable to obtain lighting information for a virtual environment, a representation generation unit operable to generate a representation of the user's face generated using the obtained lighting information, and an image output unit operable to generate an output image comprising the generated representation and an image of the virtual environment.

Content generation system and method

A gaze tracking system comprising one or more cameras operable to capture one or more images of a side view of one or both of a user's eyes, a cornea identification unit operable to identify the location and size of a cornea in one or more of the captured images, a gaze detection unit operable to determine a direction of the user's gaze in dependence upon the identified location of the cornea in the one or more captured images.

Gaze tracking apparatus and systems

A shadow rendering method for an image includes: re-projecting 3D coordinates of image pixels from an image space of the image to points on a 2D shadowmap space; estimating at least one of a horizontal and vertical distribution of the points in the shadow map space; for a flexible scale rasteriser 'FSR', updating a horizontal or vertical FSR curve corresponding to a distribution of FSR bins for the shadow map so that the corresponding horizontal or vertical distribution of points per bin is most even; and rendering the shadow map using flexible scale rasterization.

An encoding system comprising a triangle strip identification unit operable to identify a plurality of triangle strips representing at least a portion of a three-dimensional object mesh, an restart identification unit operable to identify one or more restart indices used to signify the start of a new triangle strip, a structure identification unit operable to identify one or more arrangements of triangles within the triangle strips, a data generation unit operable to generate data comprising a set of indices representing the plurality of triangle strips, information identifying the start of a new triangle strip, and information identifying a structure of a given triangle strip for one or more triangle strips, wherein the information identifying the start of a new triangle strip and the information identifying a structure of a given triangle strip are not provided in the set of indices, and a content encoding unit operable to encode the generated data for output.

Growing community of inventors

London, United Kingdom

Sahin Serdar Kocdemir