Sony Interactive Entertainment Inc.

Sony Computer Entertainment Inc.

International Business Machines Corporation

Sony Corporation

Steven Osman

Jeffrey Roger Stafford

Richard Lee Marks

Olga Rudi

Jorge Arroyo Palacios

Yunpeng Zhu

Mahdi Azmandian

Xiaodong Mao

Ruxin Chen

Javier Fernandez Rico

Todd Tokubo

Xavier Menendez-Pidal

Katrine Chow

Glenn T Black

Xiadong Mao

Gustavo Hernandez-Abrego

Saket Kumar

Jeansoo Khim

Brielle Powell

Michael G Taylor

Eric James Larsen

Celeste Bean

Victoria Walker

Crusoe Xiadong Mao

Rishi Deshpande

Care Michaud-Wideman

Charles McCoy

Dominic Saul Mallinson

Victoria Dorn

Yuichiro Nakamura

Frederick Umminger

Danjeli Schembri

Richard B Stenson

Jun Murakawa

Vlad Stamate

Christopher Ho

Morgan Fryer-McCulloch

Mark Evan Cerny

Seiji Maeda

Victor Octav Suba Miura

Brian King Flachs

Anton Mikhailov

Jason Scanlin

Katie Egeland

Angela Bartolome

Bethany Tinklenberg

Alessandra Luizello

Jeff Stafford

Lachmin Singh

Geoff Norton

Dmitri Shtilman

Rizwana Rahman

Mark Sherry

Jasmine Roberts

Kazuyuki Arimatsu

Aslanta Chen

Phoenix Nitta-Hill

Ravi Coimbatore Madhavan

Tooba Ahsen

Important information with respect to image generation such as computer game video generation can be lost once the full image is composed. To avoid this, a customized capture script is created for a computer game to specify what to capture, for future use, in the middle of rendering a game video frame, such as frame buffer, depth buffer, stencil buffers, etc. The script also specifies when during frame rendering the data is to be recorded. By capturing data mid-frame, object boundaries on the screen and relative distances between objects can be inferred. This information can be used in 2D-to-3D conversion, object coloring for increased contrast, object highlighting, etc.

Capturing computer game output mid-render for 2D to 3D conversion, accessibility, and other effects

Methods and system for providing streaming content of a video game at a client device includes receiving frames of streaming content from a game server. The frames represent a current game state. The frames are analyzed to generate predicted frames that are likely to occur following the current frames. The predicted frames are stored in a prediction frame buffer and used to fill any gaps in subsequent frames representing subsequent game state received from the game server.

Filling in frames using prediction for when connection drops

Systems and methods of intelligent reporting within online communities are provided. A current communication session associated with a plurality of user device may be monitored. The current communication session may include a stream of audio-visual content generated in real-time based on interactions between the user devices. A recording trigger may be detected within the current communication session. A recording of a portion of the stream of audio-visual content may be recorded in response to the detected trigger event. The recording may be analyzed to attribute one or more sub-portions within the recording to one or more of the user devices. At least one of the sub-portions attributed to an identified one of the user devices may be determined to meet a moderation event. A report regarding the identified user device may be generated that includes the at least one sub-portion that meets the moderation event.

Intelligent reporting within online communities

A method performed for evaluating activity in a video game, including: executing a multi-player session of a video game; during the multi-player session, receiving flag event data from a first player device, the flag event data indicating that a first player has flagged a gameplay incident occurring during the multi-player session as potentially inappropriate; responsive to receiving the flag event data, then sending a request to a plurality of second player devices, wherein responsive to said request each of the plurality of second player devices renders a voting interface to obtain voting input from each of a plurality of second players regarding whether the gameplay incident is inappropriate; receiving said voting input from the plurality of second player devices, and responsive to said voting input identifying a threshold amount of the plurality of second players considering the gameplay incident to be inappropriate, then administering a penalty for the gameplay incident.

Reporting and crowd-sourced review whether game activity is appropriate for user

Systems and methods for customized dialogue support in virtual environments are provided. Dialogue maps stored in memory may specify dialogue triggers each associated with a corresponding dialogue instruction. Data regarding an interactive session associated with a user device may be monitored based on one or more of the stored dialogue maps. The presence of one of the dialogue triggers specified by the one or more dialogue maps may be detected based on the monitored data. Customized dialogue output may be generated in response to the detected dialogue trigger and based on the dialogue instruction corresponding to the detected dialogue trigger. The customized dialogue output may be provided to the interactive session in real-time with detection of the detected dialogue trigger.

Customized dialogue support

Techniques are described for smooth switchover of computer game control. The current states of game input is communicated to a new player assuming control. The new player is allowed time to catch up to the game. New player control is detected, and any errors are communicated to the new player. If there are differences between the old control scheme and that of the new player, they are reconciled. The outgoing player is adjusted to the transition.

Smooth switchover of computer game control

To protect a user's privacy by reducing a malicious developer's ability to eavesdrop on unwitting HMD users by converting signals from a motion sensor in the HMD to speech or speaker recognition, a microphone can record ambient sound and voice which is subtracted from the motion sensor data before the sensor data is made available to the game developer. In another technique, a band pass filter subtracts frequency in the sensor signals within the voice range. Still a third technique blends statistical noise into the motion sensor signal before passing to game developers to obfuscate the user's speech. The amount by which voice components in the motion signal are eliminated or obfuscated can be tuned by a person or app.

Tunable filtering of voice-related components from motion sensor

A method, and system for controlling a computer program are disclosed. One or more images are presented on a display device in response to execution of the computer program on a computing device. Gaze tracking information corresponding to a location of a user's gaze with respect to the one or more images presented on the display device is collected over time. The gaze tracking information over time is analyzed to detect a pattern of the user's gaze characteristic of reading and upon detecting the pattern of the user's gaze characteristics of reading, a reading control mode is activated. In the reading control mode location and duration of the user's gaze triggers commands affecting execution of the computer program.

Filtering of gaze tracking information to trigger reading control mode

A method including executing game logic of a video game to generate a plurality of video frames for a game play of the video game by a player, wherein game state data is generated during the executing the game logic. The method including identifying an effect that is generated for at least one video frame in the plurality of video frames based on the game state data. The method including translating the effect to a haptic response presentable to the player simultaneous with the at least one video frame, wherein the haptic response is communicating a gaming experience that is rendered by the effect in the at least one video frame.

Impaired player accessability with overlay logic providing haptic responses for in-game effects

A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Automated artificial intelligence (AI) personal assistant

Certain aspects of the present disclosure include systems and techniques for generating content that indicates a sensation associated with audio. One example method generally includes monitoring audio to be played during display of an associated portion of an interactive content stream provided over a communication network to at least one viewing device during an interactive session, and analyzing, via a machine learning component, the audio to determine a sensation associated with at least a portion of the audio. The method may also include determining an effect indicating the sensation, wherein the effect is associated with one or more output devices associated with the at least one viewing device, and outputting an indication of the effect to the associated output devices, wherein the effect is configured to be output along with the audio in real-time with the display of the associated portion of the interactive content stream.

Contextual scene enhancement

Privacy of a conversation between a computer game player and an entity such as a person or virtual assistant is preserved by various techniques so that other players of the computer game who are not part of the conversation cannot apprehend the conversation. The conversation may be voice or txt but is not an online chat associated with the computer game.

SMS, phone and video call support while gaming

A map of a person's spatial vision abilities, including areas of low acuity and areas of high acuity, may be generated from medical records or from a calibration phase. During presentation of a computer simulation such as a computer game, the map is provided to a foveated renderer to optimize which areas should be rendered most crisply. Content placement may be optimized to ensure that any critical elements to the game, for instance, any text that needs to be seen or treasures or special pickups that need to be seen clearly can be moved into regions of the player's field of view that the person has higher acuity in.

Eye tracking for accessibility and visibility of critical elements as well as performance enhancements

Methods and systems are provided for providing navigation assistance using eye gaze of a user. An example method provides assistive navigation in a video game. The method includes receiving input from a user device during a gameplay session of the video game. The method further includes capturing eye gaze of the user during the gameplay to identify a region of a scene of the video game associated with said eye gaze. Then, activating gaze navigation to move a focus of the scene to the region identified using the captured eye gaze. The gaze navigation is triggered automatically without said input from the user device.

Methods and systems to activate selective navigation or magnification of screen content

The present disclosure generally relates to systems and methods to for encouraging spectator participation by permitting audience participation to provide different types of in-game help or hindrance to eSport players or teams when certain tiers or thresholds of spectator engagement are reached. In one example, a player's fanbase may cheer by pressing a button or providing other input/feedback. When a specific number of spectators or a level of participation is reached, a helpful object, power-up, or other in-game advantage may be given to the player. Conversely, a harmful item, loss of an object, or other in-game hindrance may be given to the player.

Triggering virtual help or hindrance based on audience participation tiers

Growing community of inventors

San Francisco, CA, United States of America

Steven Osman