Sony Computer Entertainment Inc.

Google Inc.

Sony Interactive Entertainment Inc.

John Paul Bates

Payton R White

Attila Vass

Richard B Stenson

Howard Berkey

James E Marr

Mark Evan Cerny

Antoine Labour

Keisuke Inoue

Yutaka Takeda

Tatsuya Iwamoto

Keir Banks Mierle

Gregory Alan Corson

Evangelos Kokkevis

Nathaniel Duca

Greg Corson

Hendrik Wagenaar

Atilla Vass

John Morgan

A technique includes determining a depth value for each of a plurality of pixels of a frame, down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles, determining a change in a head pose, determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex, determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex, performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame, and triggering display of the depth-adjusted time-warped frame.

Time-warping adjustment based on depth information in a virtual/augmented reality system

An example technique may include performing a first time-warping of a scene of virtual reality content based on head pose information received during or after a rendering of the scene to obtain a time-warped scene, performing a second time-warping of an object based at least on object pose information received during or after a rendering of the object to obtain a time-warped object, and displaying on a display device a composite image based on the time-warped scene and the time-warped object.

Separate time-warping for a scene and an object for display of virtual reality content

Display pre-distortion methods and apparatus for HMDs are disclosed. A disclosed example method includes determining a position of a pupil relative to a lens of the head-mounted display (HMD), determining, based on the determined position, a pre-distortion map for an image to be displayed on a display screen of the HMD, and displaying the image on the display screen of the HMD, wherein the image is modified by the pre-distortion map.

Display pre-distortion methods and apparatus for head-mounted displays

An application executed at a central processing unit (CPU) of a head mounted display (HMD) system generates sets of frame drawing commands for a graphics processing unit (GPU), and for each set of frame drawing commands the GPU renders a corresponding frame into one of a plurality of frame buffers. Each frame is generated to include or be associated with a frame number that indicates the location of the frame in the sequence of frames generated over time. In addition, each frame is generated to include or be associated with pose information indicating the pose of the HMD system when the frame is generated. At periodic preemption points, the GPU selects the frame stored at the plurality of frame buffers having the most recent frame number and applies an electronic display stabilization warp to the frame based on the difference between the current pose and the pose information stored with the selected frame.

Electronic display stabilization at a graphics processing unit

Multi-threaded processing with reduced context switching is disclosed. Context switches may be avoided through the use of pre-emption notification, a pre-emption wait time attribute and a no-context-save yield.

Multi-threaded processing with reduced context switching

Methods, systems, and apparatuses, including computer programs encoded on a computer storage medium, for rendering application content are disclosed. In one embodiment a content receiver receives application content for rendering on a display unit of a computing device. A first processing unit renders the application content onto a first frame of a plurality of frames, and a second processing unit sequentially renders the plurality of frames onto the display unit. A counter counts of a number of outstanding frames as provided by the first processing unit to the second processing unit relative to corresponding acknowledgement messages indicating that one of the outstanding frames has been rendered onto the display unit. If the count is less than a threshold, the first processing unit renders the application content onto the first frame, otherwise the first processing unit waits to render the application content until the count is less than the threshold.

Multiprocess GPU rendering model

Provided is a method and an apparatus for selectively returning parameters from an invoked object. Specifically, a requestor can invoke an object by transmitting a message. The message can include specified return parameters from an interface, such as an interface definition language (IDL). Alternatively, an object stub locally accessible by the requester can be invoked. The object stub, similar to the IDL, can specify the parameters to return. After the execution of a method in the invoked object, the requestor receives the return parameters or a subset of the return parameters previously selected.

Specifying parameters for selective return to an invoker

An atomic compare and swap operation that can be implemented in processor system having first and second processors that have different sized memory transfer capabilities. The first processor notifies the second processor to perform a compare and swap operation on an address in main memory. The address has a size less than or equal to a maximum memory transfer size for the second processor and greater than a maximum memory transfer size for the first processor. The second processor atomically performs the compare and swap operation and notifies the first processor of the success or failure of the compare and swap operation.

Atomic compare and swap using dedicated processor

Methods are provided for event notification in a decentralized peer-to-peer (P2P) network. Each node within the P2P network can publish a subscription object for a published resource. Through the use of common identifiers, each subscription object is co-located with a corresponding publish object for the resource. Upon receiving notification of an event associated with the resource, the node responsible for the publish object for the resource distributes the event notification to each node present on the corresponding subscription registry. Therefore, nodes within the P2P network that are interested in a resource are capable of establishing a persistent query for the resource by publishing a subscription object for the resource on the responsible node.

System and method for notification within decentralized network

Methods and apparatus for cell processors are disclosed. A policy module is loaded from a main memory of a cell processor into the local memory of a selected synergistic processing unit (SPU) under control of an SPU policy module manager (SPMM) running on the SPU. The policy module loads a work queue from the main memory into the local memory of the SPU. The policy module interprets and process one or more tasks from the work queue on the SPU. The selected SPU performs the task(s) and after completion or upon a pre-emption, returns control of the SPU to the SPMM.

Cell processor methods and apparatus

Task and data management systems methods and apparatus are disclosed. A processor event that requires more memory space than is available in a local storage of a co-processor is divided into two or more segments. Each segment has a segment size that is less than or the same as an amount of memory space available in the local storage. The segments are processed with one or more co-processors to produce two or more corresponding outputs. The two or more outputs are associated into one or more groups. Each group is less than or equal to a target data size associated with a subsequent process.

Processor task and data management

Methods copying data from one location to another in a main memory of a cell processor are disclosed. A portion of the data is transferred a first main memory location to the local store of one or more SPU and then transferred from the local store to a second main memory location.

Method and system for performing memory copy function

Cell processor task management in a cell processor having a main memory, one or more power processor units (PPU) and one or more synergistic processing units (SPU), each SPU having a processor and a local memory is described. An SPU task manager (STM) running on one or more of the SPUs reads one or more task definitions stored in the main memory into the local memory of a selected SPU. Based on information contained in the task definitions the SPU loads code and/or data related to the task definitions from the main memory into the local memory associated with the selected SPU. The selected SPU then performs one or more tasks using the code and/or data.

Growing community of inventors

Redwood City, CA, United States of America

John Paul Bates