Sony Interactive Entertainment Inc.

Sony Interactive Entertainment Europe Limited

Fabio Cappello

Oliver George Hume

Timothy Edward Bradley

Maria Chiara Monti

Nigel John Williams

Matthew William Sanders

Michael Lee Jones

Maurizio Cerrato

Marina Villanueva Barreiro

Michael Eder

Rosario Leonardi

Gregory James Bedwell

Rajeev Gupta

Danjeli Schembri

Marina Villanueva-Barreiro

Andrew James Bigos

Mark Jacobus Breugelmans

Mandana Jenabzadeh

Jason Gordon Doig

Robert Keith John Withey

Alexei Smith

Jason Craig Millson

Nicola Penny Ann Cavalla

Hsinpei Yang

Yasushi Okumura

Andrew William Walker

Calum Armstrong

Udupi Ramanath Bhat

David Erwan Damien Uberti

Michael Adam Kavallierou

Jessica Rose Grant

Alexander Smith

Gilles Christian Rainer

Daryl Cooper

Guy Moss

Bernard Joseph Conry

Alexei Ashton Derek Smith

Bernard Conry

A data processing apparatus includes storage circuitry to store audio data for a plurality of respective dialogue recordings for a content and to store text data indicative of a sequence of respective words within the audio data for each of the plurality of respective dialogue recordings, analysis circuitry to compare the text data for a current dialogue recording with predetermined text data for the content and to output comparison data for the current dialogue recording, the comparison data indicative of one or more differences between the text data for the current dialogue recording and the predetermined text data, selection circuitry to select one or more candidate dialogue recordings from the plurality of respective dialogue recordings for the content in dependence upon the comparison data, and recording circuitry to modify at least a portion of the audio data for the current dialogue recording in dependence upon the audio data for one or more of the candidate dialogue recordings to obtain modified audio data and to store the modified audio data for the current dialogue recording.

Apparatus and method for analysis of audio recordings

A system for positioning objects within an environment includes: an input unit operable to receive data representative of at least a portion of an environment comprising one or more features associated with the environment; an object determining unit operable to identify, for one or more objects, one or more features associated with each respective object, and operable to determine which of the one or more objects are to be positioned within the environment; and an object positioning unit operable to position the one or more determined objects within the environment in dependence upon at least one of the features associated with the environment and at least one of the features associated with each respective determined object, where the object positioning unit is operable to utilise a machine learning model, trained using one or more examples of one or more other objects positioned within at least a portion of one or more other environments in dependence upon at least one feature associated with each respective other environment and at least one feature associated with each respective other object as an input, to position the one or more determined objects within the environment.

System and method for positioning objects within an environment

A data processing apparatus includes receiving circuitry to receive graphics data for at least a portion of a virtual environment, the graphics data including a plurality of virtual objects, a machine learning model trained to output data indicative of an object classification for one or more of the virtual objects in dependence upon the graphics data, assignment circuitry to assign one or more of the virtual objects to one or more virtual object groups in dependence upon the object classification for one or more of the virtual objects, where the virtual objects assigned to a same virtual object group have a same object classification, and control circuitry to share first interaction data associated with a first virtual object assigned to a virtual object group with a second virtual object assigned to the virtual object group to thereby permit use of the first interaction data for the second virtual object in response to a user interaction with the second virtual object in the virtual environment.

Methods and apparatus for the creation and evaluation of virtual reality interactions

An image processing system for modifying one or more images of a user to change a cardiovascular activity that is measurable from the one or more images, the system comprising: an image receiving section configured to receive image data comprising a plurality of image frames; a region selection section configured to select one or more regions where the colour of the skin of the user changes temporally in the image data, wherein the colour changes are indicative of the cardiovascular activity of the user; and a modifying section configured to modify the colour change of the one or more selected regions in one or more image frames to create modified image data, as described elsewhere herein.

Image processing system and method

A method of generating video frames for a cloud-based video game includes obtaining, via a communications network, a plurality of frames of a video game rendered at a cloud device; obtaining a player input received at an input device, the input device being used to play the video game, the player input being received in response to the display of at least one of the obtained video frames; inputting at least one of the obtained video frames and the player input to a prediction model; and synthesizing, based on the output of the prediction model, a subsequent frame for output at a display, and outputting the synthesized video frame at the display.

Method and device for generating video frames

Audio communication apparatus comprises a set of two or more audio communication nodes; each audio communication node comprising: an audio encoder controlled by encoding parameters to generate encoded audio data to represent a vocal input generated by a user of that audio communication node, the encoded data being agnostic to which user who generated the vocal input; and an audio decoder controlled by decoding parameters to generate a decoded audio signal as a reproduction of a vocal signal generated by a user of another of the audio communication nodes, the decoding parameters being specific to the user of that other of the audio communication nodes.

Audio processing

An image generation system comprising an image rendering unit operable to render a first image for display to a first one of a user's eyes, an image obtaining unit operable to obtain a second image for a second one of the user's eyes, the obtained image having been rendered for display at an earlier time, an image reprojection unit operable to reproject the first image from a viewpoint associated with the first one of the user's eyes to a viewpoint associated with the second one of the user's eyes, and an image generation unit operable to generate an output image for the second one of the user's eyes in dependence upon the reprojected first image and the obtained second image.

Image generation system and method

A data processing apparatus includes input circuitry to receive audio data for a plurality of respective dialogue recordings for a video game, classification circuitry comprising one or more machine learning models to receive at least a portion of the audio data for each dialogue recording and trained to output classification data indicative of a quality classification of a dialogue recording in dependence upon one or more properties of the audio data for the dialogue recording, and storage circuitry to store identification data for one or more of the plurality of dialogue recordings in dependence upon the classification data.

Apparatus and method for audio data analysis

An image rendering method for rendering a pixel at a viewpoint includes, for a first element of a virtual scene, having a predetermined surface at a position within that scene; providing the position and a direction based on the viewpoint to a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position, combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position, and incorporating the pixel value into a rendered image for display, where the machine learning system was previously trained with a training set based on images comprising multiple lighting conditions.

Image rendering method and apparatus

A system for improving a discovery process for a virtual environment, the system comprising an environment discovery unit operable to perform a discovery process comprising navigation of the virtual environment and identification of one or more aspects of the virtual environment, a performance analysis unit operable to evaluate the effectiveness of the discovery process, and a discovery update unit operable to modify future operation of the environment discovery unit in dependence upon the evaluation.

System, method and storage medium for identification of one or more aspects of a virtual environment

A method of generating a three-dimensional (3D) reconstruction of a human includes obtaining at least one colour image and corresponding depth image of a scene comprising a human subject that is at least partially occluded by one or more items. The regions in the at least one colour image corresponding to a human subject are identified. A point cloud of the scene is generated based on the at least one colour image and corresponding depth image. One or more parameters of a parametric model are then adjusted based on the regions of the point cloud identified as corresponding to the human subject. The adjusted parametric model is then used to generate a 3D reconstruction of the human subject; where the parametric model provides an estimate for points in the point cloud corresponding to the occluded parts of the human subject. A corresponding system is also provided.

Method and system for generating a 3D reconstruction of a human

An image rendering method for rendering a pixel of a virtual scene at a viewpoint includes: downloading a machine learning system corresponding to a current or anticipated state an application determining the virtual scene to be rendered from among a plurality of machine learning systems corresponding to a plurality of states of the application; providing a position and a direction based on the viewpoint to the machine learning system previously trained to predict a factor; combining the predicted factor from the machine learning system with a distribution function that characterises an interaction of light with a predetermined surface to generate the pixel value corresponding to an illuminated first element of the virtual scene at the position; and incorporating the pixel value into a rendered image for display.

A content modification system comprising a content receiving unit operable to receive content comprising a virtual environment and one or more active elements, an input receiving unit operable to receive inputs from one or more users, an element addition unit operable to generate one or more virtual elements within the virtual environment in response to the received inputs, the virtual elements being unable to be interacted with by the one or more active elements, and a content generation unit operable to generate modified content comprising the virtual environment, the one or more active elements, and the one or more generated virtual elements.

Content enhancement system and method

A system for generating an input signal for a video game includes: a receiving unit configured to receive a video game output signal output by a video game playing device during the playing of a video game; a reasoning model configured to determine an action to take within the video game based on the received video game output signal, the reasoning model being configured to generate a representation of the determined action that is independent of the video game; and an encoding unit configured to translate the representation into an input signal and to provide the input signal to a video game playing device at which the video game is being played, thereby causing the determined action to be performed within the video game.

System and method for generating an input signal

An encoding apparatus is provided. The apparatus comprises an input unit operable to obtain a plurality of training images, said training images being for use in training a machine learning model. The apparatus also comprises a label unit operable to obtain a class label associated with the training images; and a key unit operable to obtain a secret key for use in encoding the training images. The apparatus further comprises an image noise generator operable to generate, based on the obtained secret key, noise for introducing into the training images. The image noise generator is configured to generate noise that correlates with the class label associated with the training images such that a machine learning model subsequently trained with the modified training images learns to associate the introduced noise with the class label for those images. A corresponding decoding apparatus is also provided.

Growing community of inventors

London, United Kingdom

Fabio Cappello