Sony Interactive Entertainment Inc.

Javier Fernandez Rico

Michael G Taylor

Glenn T Black

Jeffrey Roger Stafford

Steven Osman

Andrew Young

Ruxin Chen

Todd Tokubo

Erik Beran

Dennis Dale Castleman

Michael Taylor

Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

Robot utility and interface device

A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Automated artificial intelligence (AI) personal assistant

A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

Generating and rendering primitives in a frame period with late update of eye tracking information for fast foveated rendering

A method is provided, including: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; and, using the classification of the machine learning model to provide a coaching recommendation to the user.

AI modeling for video game coaching and matchmaking

A method for gaming. The method includes assigning a default game play profile to a user, wherein the default game play profile includes a default game play style that simulates human game play, and wherein the default game play profile is configured to control game play for the user based on the default game play style. The method includes monitoring a plurality of game plays of the user playing a plurality of gaming applications. The method includes generating a user game play profile of the user by adjusting the default game play style based on the plurality of game plays, wherein the user game play profile incudes a user game play style customized to the user. The method includes controlling an instance of a first gaming application based on the user game play style of the user game play profile.

Generation of an artificial intelligence (AI) model for automatic control of characters during game plays of gaming applications

A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Building saccade models for predicting a landing point of a saccade experienced by a player

A warning is generated when a computer simulation controller is determined to have insufficient charge to permit use through an upcoming simulation sequence. Thus, responsive to a computer simulation having a first context and a computer simulation controller having a first voltage, a human-perceptible indication of low voltage is presented, whereas if the computer simulation has a second context typically requiring less input than the first context, no indication is presented if the controller has the same first voltage.

Low battery switchover

A method for training a character for a game is described. The method includes facilitating a display of one or more scenes of the game. The one or more scenes include the character and virtual objects. The method further includes receiving input data for controlling the character by a user to interact with the virtual objects and analyzing the input data to identify interaction patterns for the character in the one or more scenes. The interaction patterns define inputs to train an artificial intelligence (AI) model associated with a user account of the user. The method includes enabling the character to interact with a new scene based on the AI model. The method includes tracking the interaction with the new scene by the character to perform additional training of the AI model.

Systems and methods for training an artificial intelligence model for competition matches

Late update of eye tracking information to GPU for fast foveated rendering

Gamer friend devices can be detected by a gaming console and the gaming console user can be prompted to add the friend devices to a friend list, which automatically logs the friends on to the console without requiring them to manually log in. The gaming console may also be automatically configured with profile information of the friends.

Systems and methods for providing user information to game console

'Feature points' in 'point clouds' that are visible to multiple respective cameras (i.e., aspects of objects imaged by the cameras) are reported via wired and/or wireless communication paths to a compositing processor which can determine whether a particular feature point &#x201c;moved&#x201d; a certain amount relative to another image. In this way, the compositing processor can determine, e.g., using triangulation and recognition of common features, how much movement occurred and where any particular camera was positioned when a latter image from that camera is captured. Thus, &#x201c;overlap&#x201d; of feature points in multiple images is used so that the system can close the loop to generate a SLAM map. The compositing processor, which may be implemented by a server or other device, generates the SLAM map by merging feature point data from multiple imaging devices.

Multipoint SLAM capture

Force feedback is applied to a computer simulation controller, such as to a joystick element or analog trigger of the controller, depending on the context of the simulation.

Force feedback to improve gameplay

A computer controller when in a normal orientation causes a first context of simulation play to be implemented. When inverted, the controller causes a second, different context of simulation play to be implemented.

Growing community of inventors

Pacifica, CA, United States of America

Javier Fernandez Rico