Sony Interactive Entertainment Inc.

Victoria Dorn

Celeste Bean

Mahdi Azmandian

Sepideh Karimi

Kristie Ramirez

Sarah Karp

Steven Osman

Todd Tokubo

Olga Rudi

Dennis Dale Castleman

Elizabeth Ruth Juenger

Frank Zhao

Courtney Yingling

Bethany Tinklenberg

Jing Li

Tomoyo Kimura

Sudha Krishnamurthy

Erik Beran

Elke Wiggeshoff

Megumi Kikuchi

Kaoru Yamanoue

Kristine Young

Brandon Sangston

Tatianna Manzon-Gutzman

Rui Yang

Brielle Powell

Hsin-Yi Chien

Geoff Norton

Morgan Fryer-McCulloch

Tatianna Forget

Hajime Horikoshi

Liz Juenger

Ritagya Meharishi

Alex Duplessie

Tooba Ahsen

Regina Huricks-Trapp

Yinghui Xia

Yoshimichi Kitaya

Angelica Advincula

Shunsuke Saito

Yuki Karatsu

Systems and methods for customized dialogue support in virtual environments are provided. Dialogue maps stored in memory may specify dialogue triggers each associated with a corresponding dialogue instruction. Data regarding an interactive session associated with a user device may be monitored based on one or more of the stored dialogue maps. The presence of one of the dialogue triggers specified by the one or more dialogue maps may be detected based on the monitored data. Customized dialogue output may be generated in response to the detected dialogue trigger and based on the dialogue instruction corresponding to the detected dialogue trigger. The customized dialogue output may be provided to the interactive session in real-time with detection of the detected dialogue trigger.

Customized dialogue support

A system uses map data of a virtual environment and object data of an avatar object including a moveset to generate an action path for traversal of the virtual environment by the avatar object. The system applies machine learning model(s) to generate one or more pathways through the virtual environment, and decompose the one or more pathways into one or more pathway segments that can be evaluated for feasibility and other factors. The system can iteratively generate and evaluate a move sequence of the action path having one or more parameters for execution by the avatar object. The system can construct the action path by combination of a plurality of pathway segments to satisfy one or more constraints associated with traversal by the avatar object from a start location to a destination location within the virtual environment.

Action path creation assistant

The present disclosure generally relates to providing virtual education and education to a user. More specifically, the present system relates to educating and onboarding spectators of electronic sports (eSports) events. The onboarding activities are used to further engage the spectators with the eSports event in general, as well as the game played during the eSports event. In other aspects, the eSports onboarding activity may be modified based on the type of game being played, the user's experience with the specific game or game genre, and other user preferences.

Esports spectator onboarding

A method for providing assistance during gameplay is described. The method includes accessing a profile model associated with a user account of a user. The profile model is used to generate one or more predictive indicators based on a plurality of game contexts of one or more games. The method further includes receiving a request for accessing a game for a game session via the user account and generating assistance input for the user responsive to the one or more predictive indicators that the user will be unable to complete a task in the game. The task is associated to a game context. The assistance input is provided before the user performs the task.

Systems and methods for enabling predictive assistance during gameplay

Methods and system for interpreting gestures provided by a user include capturing images of gestures provided by the user during user's interaction in metaverse and analyzing the images to identify attributes of the gestures captured in the images. The attributes of the gesture are translated into input, based on context of interaction of the user in the metaverse and communicating the input to the metaverse for applying to the interaction.

Hand gesture magnitude analysis and gearing for communicating context-correct communication

Methods and systems for processing audio for a user include identifying an interactive zone of the user as the user is interacting with a video game in a real-world environment. The real-world environment is monitored to detect any changes that can affect the interactive zone. Responsive to detecting changes, a volume of the audio directed to one side or both side of a headphone providing the audio to one or both ears of the user is dynamically adjusted. The adjustment to the audio is to prevent the user from getting distracted while interacting with the video game.

Methods and systems for dynamically adjusting sound based on detected objects entering interaction zone of user

A system and method for providing automated intervention in a virtual environment is disclosed. Intervention settings for a user are stored, wherein the intervention settings for the user includes one or more customized intervention triggers each corresponding to one or more trigger conditions and an intervention response. A current session associated with a user device of the user is monitored, wherein monitoring the current session includes analyzing interactions between the user and one or more other users in a virtual environment of the current session based on the intervention settings. One of the intervention triggers is identified as having occurred in the current session based on detecting the corresponding trigger conditions in the virtual environment. A workflow associated with the intervention response that corresponds to the identified intervention trigger is modulated based on the interactions between the user and the other users in the virtual environment. The intervention response is executed in the virtual environment of the current session based on the modulated workflow.

Personal space bubble in VR environments

Systems and methods for dynamic audio optimization associated with digital content are provided. One or more audio profiles including one or more audio settings for one or more audio output devices available to a user may be stored in memory. An incoming audio stream associated with a current interactive session of the user and real-world audio within an identified real-world space where the user is located may be monitored. One or more audio deviations may be detected based on a comparison of the incoming audio stream and the real-world audio within the identified real-world space. An audio profile associated with the current interactive session may be automatically recalibrated to modify at least one of the audio settings. The audio output device may then process audio of the incoming audio stream in accordance with the at least one modified audio setting.

Dynamic audio optimization

A method including executing game logic of a video game to generate a plurality of video frames for a game play of the video game by a player, wherein game state data is generated during the executing the game logic. The method including determining a current context in the game play of the video game based on the game state data. The method including determining a user sentiment of the player towards the current context in the game play of the video game. The method including determining that the user sentiment of the player is inconsistent with an expected user sentiment for the current context. The method including generating an in-game effect for the current context. The method including presenting the in-game effect simultaneous with one or more video frames associated with the current context in the game play of the video game.

User sentiment detection to identify user impairment during game play providing for automatic generation or modification of in-game effects

Methods of the present disclosure may collect data when a user plays one or more different types of games when determinations are made as to whether the difficulty of a game should be changed. The collected data maybe evaluated to identify whether a user gaming performance level corresponds to an expected level of performance. When the user gaming performance level does not correspond to an expected level of performance, parameters that change the difficultly of the game may be changed automatically. Parameters that relate to movement speed, delay or hesitation, character strengths, numbers of competitors, or other metrics may be changed incrementally until a current user performance level corresponds to an expectation level of a particular user currently playing the game. At this time, the user expectation level may be changed, and the process may be repeated as skills of the user are developed over time.

Adaptive difficulty calibration for skills-based activities in virtual environments

Systems and methods for emotion detection and emotion-based moderation based on voice inputs are provided. A user emotion profile may be stored in memory for a user. The user emotion profile may include one or more moderation rules that specifies a moderation action responsive to one or more emotional states. A current communication session associated with the user and one or more other users may be monitored based on the user emotion profile. An emotional state detected as being associated with a subset of the messages may trigger at least one of the moderation rules by corresponding to at least one of the emotional states specified by the user emotion profile. A presentation of at least one of the messages in the subset being provided to the user device may be modified in accordance with the moderation action specified by the user emotion profile.

Emotion detection and moderation based on voice inputs, errors in gameplay, physiological indicators of heart rate or skin tone of users of a communication session

Methods and systems are provided for providing navigation assistance using eye gaze of a user. An example method provides assistive navigation in a video game. The method includes receiving input from a user device during a gameplay session of the video game. The method further includes capturing eye gaze of the user during the gameplay to identify a region of a scene of the video game associated with said eye gaze. Then, activating gaze navigation to move a focus of the scene to the region identified using the captured eye gaze. The gaze navigation is triggered automatically without said input from the user device.

Methods and systems to activate selective navigation or magnification of screen content

Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Barometric pressure sensor arrays for detecting presence and motion of objects for tracking or triggering a response

Methods and systems are provided for integrating media cues into virtual reality scenes presented on a head mounted display (HMD) is disclosed. The method includes presenting a virtual reality scene on a display of an HMD. The method further includes receiving sensor data from one or more sensors in a real-world space in which the HMD is located. Then, identifying an object location of an object in the real-world space that produces a sound. The method includes generating a media cue in the virtual reality scene presented in the HMD. The media cue is presented in a virtual location that is correlated to the object location of the object in the real-world space.

Methods and systems for adding real-world sounds to virtual reality scenes

An audio signal processing apparatus in which different pieces of predetermined parameter information regarding acoustic transfer in a head of a listener are retained as preset candidates, a parameter information list including the retained preset candidates is presented, to prompt a user to select parameter information, and an audio signal for the user is generated by using the user-selected parameter information.

Growing community of inventors

San Mateo, CA, United States of America

Victoria Dorn