Sony Interactive Entertainment Inc.

Elizabeth Ruth Juenger

Sarah Karp

Jennifer Sheldon

Ryan David Sutton

Sepideh Karimi

Kristie Ramirez

Olga Rudi

Ellana Fortuna

Makoto Oshita

Zentaro Kaji

Celeste Bean

Mahdi Azmandian

Victoria Dorn

Katie Egeland

Lachmin Singh

Yuji Tsuchikawa

Jin Zhang

Kristine Young

Erikka Thompson

Steve Osman

Jason Grimm

Gary Grossi

Mingtao Wu

A method and system for providing gaze-based generation of virtual effects indicators correlated with directional sounds is disclosed. Gaze data is tracked via a camera associated with a client device to identify a point of focus within a three-dimensional virtual environment towards which one or both eyes of the player are focused. When the point of focus indicated by the gaze data when the point of focus does not move towards the source location within the three-dimensional virtual environment when the directional sound is received indicates that a virtual effect indicator associated with the directional sound type of the indicated directional sound is should be generated.

Gaze-based coordination of virtual effects indicators

Systems and methods for automated visual trigger profiling and detection within virtual environments are provided. A visual trigger profile may be stored in memory that includes a set of visual trigger characteristics associated with a type of visual sensitivity. Buffered frames of an audiovisual stream that have not yet been displayed may be monitored to identify when a buffered frame includes a threshold level of the visual trigger characteristics associated with the visual sensitivity. A frame modification that decreases the level of the detected visual trigger characteristics associated with the visual sensitivity may be identified and applied to the identified frames. The modified frames may thereafter be presented during the audiovisual stream in place of the original (unmodified) identified frames.

Automated visual trigger profiling and detection

A method and system for assisting a play is disclosed. A gameplay of a user of media content that is associated with a game type is received. A skill involved in the gameplay of the user is determined based on the gameplay of the user and the game type. A skill level of the user is determined based on the gameplay of the user. A training curriculum is provided to the user based on the skill and the skill level of the user upon detecting a triggering event.

Virtual dojo

Methods of the present disclosure may collect data when a user plays one or more different types of games when determinations are made as to whether the difficulty of a game should be changed. The collected data maybe evaluated to identify whether a user gaming performance level corresponds to an expected level of performance. When the user gaming performance level does not correspond to an expected level of performance, parameters that change the difficultly of the game may be changed automatically. Parameters that relate to movement speed, delay or hesitation, character strengths, numbers of competitors, or other metrics may be changed incrementally until a current user performance level corresponds to an expectation level of a particular user currently playing the game. At this time, the user expectation level may be changed, and the process may be repeated as skills of the user are developed over time.

Adaptive difficulty calibration for skills-based activities in virtual environments

Methods and systems for cooperative or coached gameplay in virtual environments are disclosed. Memory may store a content control profile regarding a set of control input associated with an action in a virtual environment of a digital content title. A request may be received from a set of one or more users associated with different source devices regarding cooperative gameplay of the digital content title. At least one virtual avatar may be generated for an interactive session of the digital content title in response to the request. A plurality of control inputs may be received from the plurality of different source devices and combined into a combination set of control inputs. Generating the combination set of control input may be based on the content control profile. Virtual actions associated with the virtual avatar may be controlled within the virtual environment in accordance with the combination set of control inputs.

Cooperative and coached gameplay

A system and method provide application assistance with a mobile device including running an application on a computer system. A challenging application state of the application is detected. An assistance for the challenging application state may be determined wherein the assistance includes display of one or more assistance frames on the mobile device. Information regarding the determined one or more assistance frames is sent to the mobile device.

Mobile game trainer using console controller

Systems and methods for determining excessive motions or strained positions based on inputs associated with gameplay of game titles. A game intervention server may evaluate, based on learning models, posture, and physical motions of players for repetitive, unbalanced, or excessive motions, as well as gameplay quality patterns, and compare to thresholds for identifying unhealthy conditions. The game intervention server may make recommendations regarding breaks, stretches, warm-up/cool-down, curbing extended periods of play, etc. Notifications may be overlaid on screen with option to pause play without exiting game session. In-game events and requirements may also be adjusted based on learned insights to avoid excessive movement or counteract unbalanced movement.

Dynamic game models

Techniques for managing notifications are described. In an example, a computing device presents content in an application window based on an execution of an application. Notification data is received by a computing device. Based on a context associated with the computing device, such as whether the application window is the foreground and whether the notification data is associated with the application or such as the operational mode of the computing device, a determination is made whether to present a corresponding notification in-context within the application window or in a pop-up window. Otherwise, the notification is added to a notification list and can be summarized in a notification summary.

Summarizing notifications on a user display

Methods of the present disclosure may also identify when certain users perform well at certain activities and perform poorly when performing other activities. A particular user could perform very well at a swimming game yet perform poorly at the first-person shooter game. This performance difference may be based on a physical impairment, be based on a lack of training, or be based on other factors. When a potential performance deficiency is identified, a user may be provided with a set of selections that allow the user to participate in a training session or that may allow the user to change functions of a gaming controller to account for the apparent performance deficiency. This additional training or change in controller functions may allow a user to have a more enjoyable user experience or may allow the user to perform at a higher level.

Profile-based detection of unintended controller errors

Data captured during a movement by the user in a real-world environment may be received from a user device associated with a user. A corresponding movement is rendered by a virtual character within a virtual environment based on the data. Video of the corresponding movement within the virtual reality environment is captured and associated with the data. The captured video and the data are provided to a recipient designated by the user. It is then verified that the recipient is performing the movement by comparing data regarding the recipient during play of the captured video to the data associated with the captured video.

Sharing movement data

Systems and methods for monitoring gameplay for monitoring real-time gameplay object data that is used to extract patterns in gameplay for generating notifications regarding control options based on extracted patterns. The notifications may indicate that selected conditions may be met based on the activity data that may be analyzed based on learning models associated with the selected conditions. The learning models may include models regarding player behavior, such as bullying or harassing language. The extract patterns may include gameplay session length, type of game played, and in-game behavior. Supervising accounts may receive recorded media segments associated with the activity data that met the selected conditions. And the user accounts engaging in such activities may be blocked and/or provided suggestions regarding alternative activities.

Intelligent recommendations for gameplay session adjustment

Techniques for managing notifications are described. In an example, a computing device receives notification data. The computing device compares a first context associated with the notification data and a second context associated with an application executing in an application window on a display. The computing device determines whether the notification data is to be presented in the application window or is to be sent to a queue based on the comparison, the queue storing other notification data corresponding to another notification. The computing device also presents, based on the comparison, at least the notification data or a notification in the application window over at least a portion of content from execution of the application while a presentation of the content continues, the notification distinct from the notification data and indicating that the notification data is presented.

User immersion context-based notifications on a user display

Dynamic game intervention

Systems and methods for audio analytics and audio-based accessibility are provided. A user audio profile may be stored in memory for a user. The user audio profile may include a custom prioritization of one or more audio parameters associated with one or more audio modifications. Audio streams associated with a user device of the user may be monitored based on the user audio profile during a current session. The audio parameters may be detected as being present in the monitored audio streams, and the detected audio parameters may be prioritized based on the custom prioritization of the user audio profile. A sound property of at least one of the audio streams may be modified in real-time based on the prioritization of the detected audio parameters by applying the audio modifications of the user audio profile to the at least one audio stream before the at least one audio stream is provided to the user device.

Growing community of inventors

San Francisco, CA, United States of America

Elizabeth Ruth Juenger