Nvidia Corporation

Amazon Technologies, Inc.

Ol2, Inc.

Google Inc.

Sony Interactive Entertainment America LLC

Sony Interactive Entertainment Inc.

Sony Computer Entertainment America LLC

Douglas Sim Dietrich

Timothy S Cotter

Nico Benitez

Steven E Molnar

Edward Anthony Hutchins

Michael J M Toksvig

Gary C King

Ashutosh Gajanan Rege

Christopher T Maughan

Jerome Francis Duluk, Jr

Robert McCool

Gurudas Somadder

Matthew Alan Townsend

Eric Peter Raeber

Michael Patrick Bauerly

Matthias Michael Wloka

Shinjan Kumar Tiwary

Jaee Patwardhan

Jean-François Roy

Gabrielle M Halberg

Bryan Harris

Donald John Darling, Jr

Katherine Wu

Erik F Nelson

Laurence Harrison

Richard O'grady

Michael S Green

Huma Dawood Khatri

A system includes a video source device connected to a video destination device via a network. The video source device includes a network interface and an encoder coupled to the network interface. The encoder is configured to encode a first stream of rendered video frames having a first frame rate to generate a second stream of encoded video frames for transmission over the network via the network interface, wherein the second stream has a second frame rate greater than the first frame rate. As part of this encoding process, the encoder is configured to selectively encode multiple instances of at least one video frame of the first stream for inclusion in the second stream to compensate for the difference between the first frame rate and the second frame rate.

Selective multiple-instance encoding of video frames to provide target frame rate during network transmission

A server executing an application generates a frame token for a frame that is rendered for the application. One or more first metric messages are provided to the application in response to at least one first operation performed by the server on the frame. The first metric messages include the frame token and information indicating timing of the at least one first operation. The encoded information representing the frame token and the frame is transmitted from the server towards a client. One or more second metric messages are provided to the application in response to one or more second operations performed by the client on the frame. The one or more second metric messages include the frame token and information indicating timing of the second operations. A state of the application is modified based on the first and second metric messages.

Timing compensation and correlation of input with frames in a video game application

A game streaming system encodes a raw frame to generate an encoded frame for a game stream including a plurality of frames for display. The system identifies a first encoding artifact based on a first difference between the encoded frame and the raw frame, and applies an overlay to the encoded frame. The overlay includes a first visual indicator indicating the first encoding artifact.

Frame overlay for encoding artifacts

One or more hardware components identify a bottleneck stage within a processor pipeline that processes frames of a video stream. The bottleneck stage has a first clock. An upstream stage receives a feedback signal from the bottleneck stage. The upstream stage has a second clock and the feedback signal includes information as to time required by the bottleneck stage to operate on data and information as to time the data spent queued. The upstream stage adjusts the speed at which the upstream stage operates and queues data to approximate the speed at which the bottleneck stage is operating and queuing data.

System and method for improving the graphics performance of hosted applications

Media devices present content such as games, audiobooks, music, movies, and so forth. During presentation of content, usage data may be acquired which provides information about how the media device is configured to present the content. For example, the usage data may indicate at which times during presentation that a user has increased or decreased volume for presentation of a movie. Information from a plurality of users may be analyzed to develop a presentation profile, which indicates at what times in the movie users have increased or decreased volume. During subsequent presentation of the content, a media device may use the presentation profile to adjust presentation settings of the content without user intervention.

Adaptive user interface configuration

A system and method for generating a corrected input to a display to offset glare is provided. The system determines a location of a user's head and calculates a reflection vector based on a head vector from a device to a point on the user's head. The system identifies light sources using a camera and determines display pixels on a display of the device affected by the reflection of the light sources based on head detection and locations of the light sources. The system dynamically adjusts pixel brightness to account for a detected glare, thus improving the user's experience operating the UI.

Glare correction via pixel processing

A virtual installation module running on a user device determines that at least one application file chunk is to be stored in a memory of the user device prior to being executed, wherein the application file chunk includes a subset of the data of the application and is stored on a remote storage device that correspond to an application to be executed by the processing device. The virtual installation module determines when a request to execute the application on the user device will be received and stores the at least one application file chunk from the remote storage device in the memory of the user device based at least in part on when the at least one application file chunk will be utilized during execution of the application.

Virtual application installation and storage for digital distribution platforms

Systems and methods are disclosed for selecting from various mechanisms for displaying a message directed to particular user(s) and/or user account(s). The mechanism by which the message may be displayed may be determined based at least in part on prediction of the importance and/or a prediction of a time criticality of the message to the user(s) to whom the message is to be delivered. The message may be received or generated by a hub user device. If the hub user device is not in the process of displaying any content on a primary display screen associated with the hub user device, then the received or generated message may be displayed on the primary display screen. If the hub user device is using the primary display screen to display any variety of content, then the message may be displayed on the primary display screen, redirected to another user device in communicative connection with the hub user device, or stored for later display based at least in part on the prediction of the importance and/or time criticality of the message.

Displaying messages according to priority

A system and method for efficiently processing a video stream using limited hardware and/or software resources. For example, one embodiment of a computer-implemented method for efficiently processing a video stream with a processor pipeline having a plurality of pipeline stages, comprises: identifying a bottleneck stage within the processor pipeline the bottleneck stage processing frames of the video stream; receiving a feedback signal from the bottleneck stage at one or more upstream stages, the feedback signal providing an indication of the speed at which the bottleneck stage is processing the frames of the video stream; and responsively adjusting the speed at which the one or more upstream stages are processing frames of the video stream to approximate the speed at which the bottleneck stage is processing the frames of the video stream.

An application/game server comprising a central processing unit to process application/video game program code and a graphics processing unit (GPU) to process graphics commands and generate a series of video frames for the application/video game; one or more back buffers to store video frames as the video frames are being created in response to the execution of the graphics commands; a front buffer-outputting the video frame for display one scan line at a time at a designated scan out frequency, a subset of scan lines stored in the front buffer being associated with a vertical blanking interval (VBI); and a frame processing module to begin copying a newly completed frame from the back buffer to the front buffer before the video data for a prior video frame stored in the front buffer has not been fully scanned out.

A game server comprising a central processing unit to process video game program code and a graphics processing unit (GPU) to process graphics commands; back buffers to store video frames in response to the execution of the graphics commands; a front buffer to receive a video frame for rendering on a display after the video frame has been completed in one of the one or more back buffers, the front buffer outputting the video frame for display one scan line at a time at a designated scan out frequency, a subset of scan lines stored in the front buffer being associated with a VBI; a frame processing module to increase the number of scan lines to increase the likelihood that a new frame will be completed in a back buffer and ready for transfer to the front buffer at a time during the VBI.

A system for hosting video games comprising: a game server comprising a central processing unit to process video game program code and a graphics processing unit (GPU) to process graphics commands; one or more back buffers to store video frames in response to the execution of the graphics commands; a front buffer to receive a video frame for rendering on a display and outputting the video frame for display one scan line at a time at a designated scan out frequency, a subset of scan lines stored in the front buffer being associated with a vertical blanking interval (VBI); a frame processing module to increase the number of scan lines associated with the VBI to increase the likelihood that a new frame will be completed in a back buffer and ready for transfer to the front buffer at a time during the VBI.

A system comprises: an application/game server comprising a central processing unit to process application/video game program code and a graphics processing unit (GPU) to process graphics commands and generate a series of video frames for the application/video game; one or more back buffers to store video frames as the video frames are being created in response to the execution of the graphics commands; a front buffer to receive a video frame for rendering on a display after the video frame has been completed in one of the one or more back buffers, the front buffer outputting the video frame for display one scan line at a time at a designated scan out frequency, a subset of scan lines stored in the front buffer being associated with a vertical blanking interval (VBI); and a frame processing module.

Growing community of inventors

Los Gatos, CA, United States of America

Douglas Sim Dietrich