Sony Interactive Entertainment Inc.

Maria Chiara Monti

Fabio Cappello

Matthew William Sanders

Timothy Edward Bradley

Oliver George Hume

Maurizio Cerrato

Jason Craig Millson

Hugh Alexander Dinsdale Spencer

Patrick John Connor

Michael Eder

Rosario Leonardi

Mark Jacobus Breugelmans

Alexander Smith

Alexei Smith

Pedro Federico Quijada Leyton

Guy Moss

Hugh Spencer

A content rendering and display system operable to display content to a viewer, the system comprising a rendering unit operable to render an image having a first resolution in a first render pass, and to generate supplementary information in additional render passes, wherein the rendered image and the supplementary information are stored in a multi-layer image structure, an upsampling unit operable to perform an upsampling process on the rendered image so as to generate an image having a portion at a second resolution higher than the first resolution, wherein the upsampling process comprises a morphological antialiasing process that uses the supplementary information as an input, and a display device operable to display the upsampled image, wherein the supplementary information comprises edge information for the rendered image.

Image processing system and method

A system for obtaining content for display to a user of a head-mountable display device, HMD, the system comprising one or more audio detection units operable to capture audio in the environment of the user, a motion prediction unit operable to predict motion of the HMD in dependence upon the captured audio, and a content obtaining unit operable to obtain content for display in dependence upon the predicted motion of the HMD.

Display system and method

An image generation system comprising an image rendering unit operable to render a first image for display to a first one of a user's eyes, an image obtaining unit operable to obtain a second image for a second one of the user's eyes, the obtained image having been rendered for display at an earlier time, an image reprojection unit operable to reproject the first image from a viewpoint associated with the first one of the user's eyes to a viewpoint associated with the second one of the user's eyes, and an image generation unit operable to generate an output image for the second one of the user's eyes in dependence upon the reprojected first image and the obtained second image.

Image generation system and method

A method of controlling at least a first non-player object within a virtual environment of an application includes: selecting a template non-player object behavioural AI model, the AI model being previously trained separately to the application using reinforcement learning to characterise behaviour of a respective non-player object type, from among a plurality of template AI models, associating one or more non-player objects of the application with the selected template AI model, and for the or each associated non-player object, inputting application state information to an input interface of the template AI model for receiving state information relevant to the associated non-player object's type, and receiving from an output interface of the template AI model non-player object state information, and then updating the state of the respective non-player object for the virtual environment of the application responsive to the received non-player object state information.

Virtual environment development method and system

A method of recording a seamless customised video recording of a video game, the method comprising the steps of: video recording a first run-through of at least a part of the video game; saving a saved-game state of a first game state of the video game, the saved-game state enabling a game state of the video game to be reset to the saved-game state that is at least visually identical to the first game state; detecting, in response to the saving of the saved-game state, a time within the video recording of the first run-through corresponding to the time the saved-game state is saved; video recording, when the game state is reset to the saved-game state, another run-through from the saved-game state; and editing the video recording of the first run-through by replacing some or all the video recording of the first run-through recorded from the detected time with the video recording of the other run-through when the other run-through meets a predetermined preference criterion.

Video recording system and method

An input generation system operable to generate one or more inputs for a gaze tracking system, includes an input receiving unit operable to receive one or more inputs, an input processing unit operable to generate motion data in dependence upon the received inputs, where the motion data comprises simulated gaze information, and an output unit operable to output the generated motion data.

Input generation system and method

A wearable data processing apparatus includes one or more attachment members for attaching the wearable data processing apparatus to a part of a limb of a user, one or more sensors to generate user input data in response to one or more user inputs, wireless communication circuitry to transmit the user input data to an external device and to receive control data based on the user input data from the external device, processing circuitry to generate one or more output signals in dependence upon the control data and an output unit to output one or more of the output signals.

Wearable data processing apparatus, system and method

A head-mountable display (HMD) system includes at least one detector to detect a gaze direction of an eye of a user wearing the HMD, receiving circuitry to receive a user input from the user indicating a type of eye condition for the eye of the user associated with at least partial vision loss for a region of vision, a display unit to display one or more images to the user, and a processor to generate the one or more images for display to the user by the display unit in dependence upon the type of eye condition and an output of the at least one detector indicative of the detected gaze direction of the eye.

Gaze tracking apparatus and systems

A content modification system comprising a content receiving unit operable to receive content comprising a virtual environment and one or more active elements, an input receiving unit operable to receive inputs from one or more users, an element addition unit operable to generate one or more virtual elements within the virtual environment in response to the received inputs, the virtual elements being unable to be interacted with by the one or more active elements, and a content generation unit operable to generate modified content comprising the virtual environment, the one or more active elements, and the one or more generated virtual elements.

Content enhancement system and method

A data processing apparatus includes avatar monitoring circuitry to receive gaze data for a first user associated with a first avatar in a virtual reality environment, the gaze data for the first user indicative of a gaze point for the first user with respect to the virtual reality environment, in which the avatar monitoring circuitry is configured to select one or more objects in the virtual reality environment in dependence upon the gaze data for the first user and to store first avatar information for the first avatar indicative of one or more of the selected objects, input circuitry to receive gaze data for a second user indicative of a gaze point for the second user with respect to the virtual reality environment, and processing circuitry to generate one or more images for the virtual reality environment for display to the second user, in which the processing circuitry is configured to: select the first avatar in dependence upon the gaze point for the second user with respect to the first avatar; and generate the one or more images to include at least one graphical element indicative of the first avatar information in response to the selection of the first avatar.

Data processing apparatus and method of using gaze data to generate images

A gaze tracking system comprising a first camera operable to capture images of a user within an environment, a second camera, having a smaller field of view than the first camera, operable to capture images of at least one of the user's eyes, an eye identification unit operable to identify a location of at least one of the user's eyes from images captured by the first camera, a camera control unit operable to modify the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes, and a gaze direction identification unit operable to identify a gaze direction of the user from images captured by the second camera.

A content generation system, the system comprising an input obtaining unit operable to obtain one or more samples of input text and/or audio relating to a first content, an input analysis unit operable to generate n-grams representing one or more elements of the obtained inputs, a representation generating unit operable to generate a visual representation of one or more of the generated n-grams, and a display generation unit operable to generate second content comprising one or more elements of the visual representation in association with the first content.

Content generation system and method

A data processing apparatus includes input circuitry to receive viewpoint data indicative of respective viewpoints for a plurality of spectators of a virtual environment, detection circuitry to detect a portion of the virtual environment viewed by each of the respective viewpoints in dependence upon the viewpoint data, selection circuitry to select one or more regions of the virtual environment in dependence upon at least some of the detected portions, and output circuitry to output data indicative of one or more of the selected regions.

Apparatus and method for data aggregation

A system configured to perform an eye tracking process using a head-mountable eye-tracking arrangement, the system comprising an eye tracking unit, located on the head-mountable arrangement, operable to detect motion of one or both of the user's eyes, a relative motion identification unit operable to identify motion of the head-mountable arrangement relative to the user's head, and a correction unit operable to determine a correction to the eye tracking process in dependence upon the identified motion of the user's head relative to the head-mountable arrangement.

A head-mountable display (HMD) system includes at least one detector to detect movement of an eye of a user wearing the HMD, control circuitry to detect saccadic movement of the eye in dependence upon the detected movement of the eye, a display unit and a processor to generate images for display to the user by the display unit, in which the control circuitry is configured to control the processor in response to the detected saccadic movement, in which the control circuitry is configured to control the processor to adjust one or more image quality parameters for one or more of the images to be displayed by the display unit during the detected saccadic movement.

Growing community of inventors

London, United Kingdom

Maria Chiara Monti