Sony Interactive Entertainment Inc.

Justice Adams

Masanori Omote

Arindam Jati

Sudha Krishnamurthy

Naveen Kumar

Ashish Singh

Jorge Arroyo Palacios

Mario M Sarria, Jr

Nirmal Rajkumar

Jeffrey Roger Stafford

Jeff Stafford

Jian Zheng

Michael Chow

A system enhances existing audio-visual content with audio describing the setting of the visual content. A scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. A text to speech synthesis module may then convert the caption to synthesized speech data describing the scene elements within the image frame

Scene annotation using machine learning

Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module generates a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream.

Graphical style modification for video games using machine learning

A method is provided, including the following operations: monitoring gameplay activity in a plurality of game sessions, wherein the monitoring includes, for each game session, analyzing the gameplay activity in said game session to predict future gameplay activity in said game session; identifying one or more characteristics of a plurality of spectators interacting with a virtual character, wherein each of the spectators interacting with the virtual character accesses, over a network, a channel that is attributed to the virtual character; through the channel, providing access to the spectators to spectate a selected game session that is one of the plurality of game sessions, selected based on the predicted future gameplay activity and based on the characteristics of the plurality of spectators.

Driving virtual influencers based on predicted gaming activity and spectator characteristics

A method, including: executing a video game; enabling spectating of gameplay of the video game, over a network, by a plurality of spectators; receiving, over the network, comments from the spectators during the spectating of the video game; using a semantic analysis process to analyze the comments to determine content of the comments; responsive to the content of the comments, performing an action by a virtual character that is presented to the spectators.

Virtual influencers for narration of spectated video games

Accommodation for color or visual impairments may be implemented by selective color substitution. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. The color accommodation module may include a rule based filter that substitutes one or more colors within the image frame with one or more corresponding alternative colors.

Textual annotation of acoustic effects

A method for identifying game events includes providing a spectator channel for a video game, detecting a tag selection in the game while it is being played, and identifying a screen location associated with the tag selection. The method includes examining the screen location to identify game action occurring proximate to the tag selection, and accessing a recording of the game including the game action. The recording includes a plurality of frames associated with state data and metadata, and the method includes examining this data to quantify the recording. The examining assigns a significance value using the state data and metadata. A video clip from the recording associated with the tag selection is stored when the significance value exceeds a predefined threshold. The video clip is viewable (watch mode) and playable (play mode), which uses state data to execute a portion of the game that relates to the clip.

System assisted replay of exceptional game events in a video game

Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module receives a first image frame from a host system and applies a style adapted from a second image frame to the first image frame to generate a style adapted first image frame.

Growing community of inventors

San Mateo, CA, United States of America

Justice Adams