Sony Interactive Entertainment Inc.

Sony Computer Entertainment Inc.

Sony Computer Entertainment America LLC

Sony Interactive Entertainment America LLC

Dominic Saul Mallinson

Anton Mikhailov

Richard Lee Marks

David Perry

Warren M Benedetto

Michael G Taylor

Masayuki Chatani

Jeffrey Roger Stafford

Steven Osman

Eric James Larsen

Gary M Zalewski

Ruxin Chen

Xiaodong Mao

Jeff Stafford

Methods for tagging content in a video game title during game play executed on a game cloud system, and social sharing methods. One method includes receiving a pause indication during the game play and suspending the game play to hold the video game title in a current frame image, storing the game state, and receiving the tag data that is associated to a location in the current frame image and to a user identifier for the current frame image. The method further includes generating a video recording of the game play having the tag data and generating a mini-game from a portion of the video game title. The mini-game includes a playable portion to enable view of a portion of the video recording for the mini-game and an executable portion to enable the play of game code for the mini-game that is a portion of the video game title.

Systems and methods for tagging content of shared cloud executed mini-games and tag sharing controls

A method for method for classification of virtual reality (VR) content for use in head mounted displays (HMDs). The method includes accessing a model that identifies a plurality of learned patterns associated with the generation of corresponding baseline VR content that is likely to cause discomfort. The method includes executing a first application to generate first VR content. The method includes extracting data associated with simulated user interactions with the first VR content, the extracted data generated during execution of the first application. The method includes comparing the extracted data to the model to identify one or more patterns in the extracted data matching at least one of the learned patterns from the model such that the one or more patterns are likely to cause discomfort.

Method and system for classifying virtual reality (VR) content based on modeled discomfort of a user

A method for rendering computer graphics based on saccade detection is provided. One embodiment of the method includes rendering a computer simulated scene for display to a user, detecting an onset of a saccade that causes saccadic masking in an eye movement of the user viewing the computer simulated scene, and reducing a computing resource used for rendering frames of the computer simulated scene during at least a portion of a duration of the saccade. Systems perform similar steps, and non-transitory computer readable storage mediums each storing one or more computer programs are also provided.

Apparatus and method for dynamic graphics rendering based on saccade detection

A method for reducing discomfort when viewing virtual reality (VR) content for use in head mounted displays (HMDs). The method includes accessing a model that identifies a plurality of learned patterns associated with the generation of corresponding baseline VR content that is likely to cause discomfort. The method includes processing a first application to generate data associated with simulated user interactions with first VR content of the first application. The method includes comparing the data to the model to identify a pattern in the data matching at least one of the learned patterns, such that the identified pattern is likely to cause discomfort. The method includes identifying a zone in the first application corresponding to identified pattern. The method includes applying a discomfort reduction filter effect within the zone for purposes of reducing potential discomfort in a user.

Field of view (FOV) throttling of virtual reality (VR) content in a head mounted display

Methods and systems for using a robot to provide feedback to a user when the user is engaged in a physical activity includes detecting presence of the user in a geo-location. The user is identified and associated with the robot. User activity in the geo-location is monitored and when the robot detects the user is performing an exercise from an exercise routine, the robot is positioned to one or more positions proximate to the user so as to capture image of a posture held by the user while performing the exercise. The captured image is analyzed and feedback provided to the user to allow the user to improve their posture.

Robot as personal trainer

A system is provided, including: a head-mounted display (HMD), including, a plurality of retroreflectors, and a display device; an emitter/detector unit, including, an emitter configured to emit a scanning beam into an interactive environment, the scanning beam being configured to continuously trace a predefined scan pattern, and a detector configured to detect reflections of the scanning beam back to the HMD by each of the plurality of retroreflectors; a computing device, including, a processor configured to, for each retroreflector, determine a time at which the reflection occurred, wherein the time is used to determine a location or orientation of the HMD in the interactive environment, the computing device configured to generate a view of a virtual space based on the determined location or orientation of the HMD; wherein the display device of the HMD is configured to render the view of the virtual space.

Tracking using retroreflectors mounted on a head-mounted display

A head-mounted display (HMD) is provided, including the following: an emitter configured to emit a scanning beam into an interactive environment in which the HMD is disposed, the scanning beam being configured to continuously trace a predefined scan pattern; a detector configured to detect reflections of the scanning beam back to the HMD by each of a plurality of reflectors; a processor configured to, for each reflector, determine a time at which the reflection of the scanning beam by the reflector occurred, wherein the time is used to determine a location or orientation of the HMD in the interactive environment; a display device configured to render a view of a virtual space that is determined based on the determined location or orientation of the HMD.

Head-mounted display tracking using corner reflectors

A system and method of tracking a location of a head mounted display and generating additional virtual reality scene data to provide the user with a seamless virtual reality experience as the user interacts with and moves relative to the virtual reality scene. An initial position and pose of the HMD is determined using a camera or similar sensor mounted on or in the HMD. As the HMD is moved into a second position and pose, images of two or more fixed points are captured by the camera or sensor to determine a difference in position and pose of the HMD. The difference in position and pose of the HMD is used to predict corresponding movement in the virtual reality scene and generate corresponding additional virtual reality scene data for rendering on the HMD.

Tracking system for head mounted display

A head-mounted display (HMD) is provided, including: an emitter configured to emit a scanning beam into an interactive environment, the scanning beam being configured to continuously trace a predefined scan pattern; a detector configured to detect reflections of the scanning beam back to the HMD by each of a plurality of modulating retroreflectors; a processor configured to, for each detected reflection of the scanning beam, analyze the detected reflection to identify the modulating retroreflector that produced the reflection, and further determine a time at which the reflection occurred, wherein the times at which the reflections occurred and the identification of the modulating retroreflectors that produced the reflections are used to determine a location or orientation of the HMD in the interactive environment; a display device configured to render a view of a virtual space that is determined based on the determined location or orientation of the HMD.

Active retroreflectors for head-mounted display tracking

A method for tracking eye movement is provided. One embodiment of the method includes receiving a first measurement from a first sensor configured to detect a gaze location, determining an initial gaze location based at least on the first measurement, receiving at least one of eye motion amplitude and eye motion direction measurement from a second sensor, and determining an estimated gaze location based at least on the initial gaze location and the at least one of eye motion amplitude and eye motion direction. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.

Growing community of inventors

Redwood City, CA, United States of America

Dominic Saul Mallinson