Sony Interactive Entertainment Inc.

Sony Interactive Entertainment America LLC

Bhaswar Sarkar

Mohammed Aafaq Khan

Mohammed Khan

A method including establishing a multi-player gaming session of a gaming application that generates an interactive gaming world, the live event being a real-world venue where players playing the gaming application are present. A 3D live view of the venue is generated based on captured video streams, and generated for a physical POV anchored to a physical location in the venue. The 3D live view is streamed to an HMD of a remote user located outside the venue, and presents an augmented reality view of the live event. A request is received from the remote user to jump into the gaming session as a spectator of the interactive gaming world from a virtual POV defined by a virtual location in the gaming world. The spectator view is delivered to the HMD of the remote user for display, the spectator view presenting a virtual reality view of the interactive gaming world.

Spectator view into a live event held in a real-world venue

A method is provided, including: receiving, from a client device, a request to spectate a live event by a remote spectator; assigning the remote spectator to a seat in a physical venue; streaming a first video feed, captured by a first camera in the physical venue, to the client device for rendering to a first display for viewing by the remote spectator, wherein the first video feed provides a field of view of the physical venue; rendering a second video feed, from a second camera that captures the seat in the physical venue, to a display device in the physical venue; wherein when the field of view provided by the first video feed includes the display device in the physical venue, then the rendering of the second video feed on the display device that is shown in the field of view is altered, showing the remote spectator in the seat.

Insertion of VR spectator in live video of a live event

Spectator view into an interactive gaming world showcased in a live event held in a real-world venue

In some implementations, a method is provided, including the following operations: receiving, over a network from a client device, a request to spectate a live event through a head-mounted display by a virtual reality spectator; assigning the virtual reality spectator to a seat in a venue in which the live event takes place; receiving a plurality of video feeds from a plurality of cameras positioned in the venue; accessing video processing parameters that are stored in association with the seat; using the video processing parameters to select and stitch selected ones of the video feeds to generate a composite video that provides a view of the venue from a perspective that is substantially defined by a 3D location of the seat in the venue; transmitting the composite video over the network to the client device for rendering to the head-mounted display.

Growing community of inventors

San Mateo, CA, United States of America

Bhaswar Sarkar