Sony Interactive Entertainment Inc.

Marvellworld Trade Ltd.

Marvell International Limited

Todd Tokubo

Jeffrey Roger Stafford

Glenn T Black

Michael G Taylor

Steven Osman

Xiaodong Mao

Javier Fernandez Rico

Ken Yeung

Gladys Yuen Yan Wong

Ronak Anjan Chokshi

George Lee

Timothy Li

Ninh Tran

Crusoe Xiadong Mao

Andrew Young

Mahdi Azmandian

Dennis Dale Castleman

Victoria Dorn

Sameer Bidichandani

Erik Beran

Aswath Mohan

Arthur Charles Kwun

Jorge Arroyo Palacios

Frederick Umminger

Xiaoyong Ye

Zhenhao Ge

Matthew Bennett

Brendan Rehon

Hadi Alamdar

Blake Buzzini

Joshua M Eads

Methods and systems for normalizing views of real world space and virtual environment of an interactive application as viewed through a pair of augmented reality glasses include receiving content of the interactive application for rendering on a display screen of the pair of augmented reality glasses. The content is streaming content provided in response to inputs provided by the user and includes virtual objects. The virtual objects are dynamically scaled to match a scale of the real world objects to a scale of the virtual objects. The content of the interactive application dynamically scaled is projected as an overlay over the real world objects of the real world space viewed through the pair of augmented reality glasses. The content that is dynamically scaled enables a normalized view between the real world space and the virtual environment.

Projector assisted augmented reality, adjusting AR size, shape and presentation based on real world space

A method is provided for refining calibration of a user input for a video game, including: performing an initial calibration process for a user input for the video game, wherein the initial calibration process determines calibration settings for the user input; initiating gameplay of the video game using the calibration settings determined from the initial calibration, such that the calibration settings are applied to interpret instances of the user input occurring during the gameplay; determining a game context in which the instances of the user input occur; analyzing the determined game context, and adjusting the calibration settings based on the analysis of the determined game context.

Dynamic in-game refinement of calibration of user input

A garment system is provided, including: a main component configured to be worn by a user, the main component having a flexible display portion and a sensor; a detachable component configured to be detachably coupled to the main component; wherein the sensor detects when the detachable component is attached to, or detached from, the main component, and responsively triggers a change in imagery presented on the flexible display portion in response to said attachment or detachment of the detachable component.

Merchandise with flexible display and detachable component

Methods and systems for determining a type of material of an object in a real-world environment are described. One of the methods includes receiving a plurality of sets of audio data based on sounds received from a plurality of objects within a plurality of environments. The method further includes receiving a plurality of sets of input data regarding a plurality of types of materials of the plurality of objects, training an artificial intelligence (AI) model based on the plurality of sets of audio data and the plurality of sets of input data, and applying the AI model to a set of audio data captured from the real-world environment to determine the type of material of the object within the real-world environment to enhance the realism of augmented reality (AR) or virtual reality (VR) video games and applications.

Systems and methods for determining a type of material of an object in a real-world environment

The performance of a player of a computer game is noted and the player accorded a latency handicap based thereon. The latency handicap is used to slow down play of the computer game, preferably only during times of high player activity. The latency handicap can be reduced over time or owing to improvement in the player's performance.

Adaptive time dilation based on player performance

A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Automated artificial intelligence (AI) personal assistant

Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.

Systems and methods for determining movement of a controller with respect to an HMD

Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Barometric pressure sensor arrays for detecting presence and motion of objects for tracking or triggering a response

Systems and methods for receiving a scene by a head mounted display (HMD) of an HMD user. One method includes receiving image data of a real world space where the HMD is located. The image data is analyzed to identify positional data on the one or more spectators present in the real world space. The method includes identifying, based on the positional data, that a personal space of a spectator is being encroached. The identifying causing an indicator to alert the HMD user of said encroachment of said personal space of the spectator.

Delivery of spectator feedback content to virtual reality environments provided by head mounted display

Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model. The processing is configured to generate a recommendation to the user regarding an action to take to progress in the game during said current gameplay.

Human performance capturing for artificial intelligence recommendations

Methods and systems describe augmenting image content presented on a mirror display. The method includes detecting images of a user in an activity volume in front of the mirror display; the detecting includes identifying a body of the user and tracking movements by the user while in the activity volume. The method includes receiving a request to predict a change in physique of the body of the user, the request includes input parameters that identify a physical exercise and an amount of said physical exercise. The method includes generating an augmented image of the body of the user; the augmented image of the body has said change in physique, the change in physique of the body is assembled from one or more three-dimensional (3D) models of one or more body parts of the body that have been adjusted in shape.

Augmented image adjustment of user based on possible actions or non-actions

Methods and systems are provided for processing feature similarity for a real-world space used for augmented reality (AR) gameplay is disclosed. The method includes receiving captured sensor data from the real-world space used by a user for said AR gameplay of a game. The sensor data provides data to identify characteristics of physical objects in the real-world space. The method includes generating a user space score using the characteristics of the physical objects identified in the real-world space. The method includes comparing the user space score to a game space score that is predefined for the game. The comparing is used to produce a fit handicap for the AR gameplay of the game in the real-world space by the user. Adjustments to gameplay parameters may be made to compensate or adjust the fit handicap.

Feature similarity scoring of physical environment for augmented reality gameplay

Methods for providing guidance to a user wearing a head mounted display (HMD) are provided. One example method includes using a camera of the HMD to track the user wearing the HMD in a real-world space, and identifying a safe zone within the real-world space for interacting with a virtual reality space via the HMD. The method further includes detecting movements of the user in the real-world space. The method includes integrating content into the virtual reality space. The content is configured to provide guidance in direction of movement of the user toward the safe zone of the real-world space. If the user continues to move away from safe zone, pausing presentation of the virtual reality space, and resuming the presentation when the user is in the safe zone.

Methods for providing interactive content in a virtual reality scene to guide an HMD user to safety within a real world space

A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

Gaming device with rotatably placed cameras

A method is provided, including: tracking a location of a head-mounted display (HMD); tracking a gaze of a user of the HMD; generating video depicting a view of a virtual environment for the HMD based on the gaze of the user of the HMD; initiating wireless transmission of the video to the HMD for display on the HMD to the user, wherein initiating the wireless transmission includes setting a beamforming of a wireless transceiver towards the location of the head-mounted display; processing signal quality feedback received from the HMD to determine a quality of the wireless transmission; responsive to a loss in the quality of the wireless transmission, then adjusting the beamforming of the wireless transceiver.

Growing community of inventors

Newark, CA, United States of America

Todd Tokubo