Sony Interactive Entertainment Inc.

Sony Interactive Entertainment America LLC

Sony Computer Entertainment Inc.

Sony Computer Entertainment America LLC

Mohammed Aafaq Khan

Ken Miyaki

Miao Li

Shawn He

Bhaswar Sarkar

Stuart Platt

Matt DeVico

Yasutaka Miwa

Ramana Bangalore Prakash

Christopher Reese

Vinod Tandon

Hai Jie Hewu

Joseph Dodson

Mark Fortuna

Scott Kirkland

Computer game metadata is used to select a video widget provided in a video template. The widget can be operable to present metadata in the video template, change an association between features of the video template and metadata generated during play of a computer game, search for clips similar to a video clip presented by the video template, vary a length of a video clip presented by the video template, or vary an intensity of action used to select a video clip presented by the video template.

Selection of video widgets based on computer simulation metadata

Methods and systems are provided for delivering a virtual reality (VR) experience of a real world space to a remote user via a head mounted display (HMD). A method provides for sending a request for the VR experience of the real world space and identifying a viewing location made by the user. The method includes operations for mapping the viewing location to a real world capture system for capturing video and audio at a location that corresponds to the viewing location and receiving real world coordinates for the real world capture system. Further, the method accesses a user profile of the user and receives a video stream of the real world space captured by the real world capture system. The method is able to identify and reskin a real world object with a graphical content element by overlaying the graphical content item in place of the image data associated with the real world object.

Virtual reality presentation of real world space

Computer game metadata is used to select a video template for delivery to a user to populate the template with a video of the player or the game. Each template can be associated with its own unique text, audio, overlays, and the like, in other words, its own style, which depends on the metadata collected during the course of game play.

Selection of video template based on computer simulation metadata

Methods and systems are provided for augmenting a video game with an image of a real world person. One example method includes executing the video game at a server. The video game is played by a user via a user device. The method includes identifying a generic spectator within the video game. The method includes determining virtual coordinates associated with the generic spectator. The method includes receiving, at the server, data associated with the image of the real world person. The data is usable to display at least part of the image of the real world person within the video game. The method includes inserting said at least part of the image of the real world person into the video game at the virtual coordinates associated with the generic spectator. The method includes streaming video to the user device. The video includes said at least part of the image of the real world person. The identifying of the generic spectator includes selecting the generic spectator from a plurality of generic spectators based on a level of visibility of the generic spectator has with respect to a point of view of the user when playing the video game.

Augmenting virtual reality video games with friend avatars

A method is provided, including: receiving, from a client device, a request to spectate a live event by a remote spectator; assigning the remote spectator to a seat in a physical venue; streaming a first video feed, captured by a first camera in the physical venue, to the client device for rendering to a first display for viewing by the remote spectator, wherein the first video feed provides a field of view of the physical venue; rendering a second video feed, from a second camera that captures the seat in the physical venue, to a display device in the physical venue; wherein when the field of view provided by the first video feed includes the display device in the physical venue, then the rendering of the second video feed on the display device that is shown in the field of view is altered, showing the remote spectator in the seat.

Insertion of VR spectator in live video of a live event

A method for localizing sound when enabling participation in a live event, including establishing a multi-player gaming session of a gaming application that generates an interactive gaming world, the live event being a real-world venue where players playing the gaming application are present. A live view of the venue is generated based on captured video streams, and generated for a physical POV anchored to a physical location in the venue. Audio is generated for the live event, and modified to reflect acoustics of the real-world venue for the physical location. The modified audio is synchronized to the live view. The live view and synchronized audio are streamed to an HMD of a remote user located outside the venue, and presents an augmented reality view of the live event.

Sound localization in an augmented reality view of a live event held in a real-world venue

A method and apparatus for synchronizing the playback of a media title to a group of client device platforms is disclosed. A synchronizer may make adjustments to the playback modes of one or more client device platforms within a group watching the same media title in order to ensure synchronized playback. When a client device platform is behind the group its playback mode may be changed to a fast playback mode. When a client device platform is ahead of the group its playback mode may be changed to a slow playback mode. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Playback synchronization in a group viewing a media title

Methods and systems are provided for augmenting a video game with an avatar of a real world person. A method provides for executing a video game being played by a user via a head mounted display (HMD). The method includes operations for identifying a generic spectator within the video game and determining virtual coordinates associated with the generic spectator. The method also provides receiving data associated with an avatar of a real world person that is usable to display the avatar within the video game in three-dimensional (3D) form. The method provides removing the generic spectator from view within the video game and inserting the avatar into the video game at the virtual coordinates associated with the generic spectator. The method further provides rendering a virtual reality (VR) presentation of the video game for the user having a view of the avatar and sending the VR presentation to an HMD of the user for display.

A method for editing. The method includes receiving a sequence of interactive VR scenes of digital content, each interactive VR scene showing a 3D gaming environment. The method includes placing the sequence of interactive VR scenes within a 3D editing space. The method includes sending a view of the 3D editing space including at least one of the sequence of interactive VR scenes to an HMD for viewing by the user. The method includes receiving at least one input editing command from a device of the user. The method includes modifying the sequence of interactive VR scenes in response to the input editing command, wherein the at least one editing command is provided through an input enabled while wearing the HMD and viewing the 3D editing space via the HMD so as to provide real-time views showing modifications made to the sequence of interactive VR scenes.

Three dimensional digital content editing in virtual reality

In some implementations, a method is provided, including the following operations: receiving, over a network from a client device, a request to spectate a live event through a head-mounted display by a virtual reality spectator; assigning the virtual reality spectator to a seat in a venue in which the live event takes place; receiving a plurality of video feeds from a plurality of cameras positioned in the venue; accessing video processing parameters that are stored in association with the seat; using the video processing parameters to select and stitch selected ones of the video feeds to generate a composite video that provides a view of the venue from a perspective that is substantially defined by a 3D location of the seat in the venue; transmitting the composite video over the network to the client device for rendering to the head-mounted display.

Venue mapping for virtual reality spectating of live events

Methods and systems are provided for delivering a virtual reality (VR) experience of a real world space to a remote user via a head mounted display (HMD). A method provides for sending a request for the VR experience of the real world space and identifying a seat selection made by the user. The method includes operations for mapping the seat selection to a real world capture system for capturing video and audio at a location that corresponds to the seat selection and receiving real world coordinates for the real world capture system. Further, the method accesses a user profile of the user and receives a video stream of the real world space captured by the real world capture system. The method is able to identify and reskin a real world object with a graphical content element by overlaying the graphical content item in place of the image data associated with the real world object.

Recommending game-playing friends or buddies, including: receiving at least one of playing habits, behaviors, and preferences of online game players; selecting a subset of the online game players matching a set number of criteria of the at least one of playing habits, behaviors, and preferences that are similar or complementary; and recommending the subset of the online game players selected as matching a set number of criteria as game-playing friends or buddies. Keywords include improved game experience, social building, and community growing.

Online process for recommending friends based on game playing habits

Using persistent party rooms, including: initializing, via a computing device, a global array according to a hierarchical server architecture; determining, via the computing device, whether or not to create a new persistent party room or to join a previously bookmarked persistent party room; creating, via the computing device, the new persistent party room within a position indexed in the global array; and joining, via the computing device, the previously bookmarked persistent party room by searching for the previously bookmarked party room utilizing the global array.

Growing community of inventors

Poway, CA, United States of America

Mohammed Aafaq Khan