Intel Corporation

Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Tyzx, Inc.

Steve John Clohset

Zohar Bogin

Warren Andrew Hunt

Narendra S Khandekar

Nilanjan Goswami

Pierre St Hilaire

Wishwesh Anil Gandhi

John Iselin Woodfill

Juan-Carlos Calderon

Jing Ling

Gaile Gordon

Jean-Michel Caia

Richard Lawrence Greene

Tuong P Trieu

Christopher James Goodman

Hideo Tamama

Ronald John Buck

Benjamin Charles Constable

Mikal Hunsaker

Thomas A Piazza

Aditya Sreenivas

Trung Am Diep

Michael Yee

Alok Kumar Mathur

Vivek Joshi

Serafin E Garcia

Soowan Suh

Anguo Tony Huang

Eduard Lecha

Eugene Gorbatov

Vasan Karighattam

Piyush Agarwal

Shanmathi Natarajan

Kyle Durfee

A method includes receiving a source shape that is to be blended with a destination shape stored in a color buffer for an image; in response to determining that the source shape is associated with a blending mode that requires updates to pixels in the color buffer uncovered by the source shape: identifying empty tiles in the color buffer uncovered by the source shape and non-empty tiles in the color buffer covered by the source shape; for each of the empty tiles, sending instructions to clear pixel values associated with the empty tile in the color buffer; and for each of the non-empty tiles: identifying pixels of the non-empty tile that are covered by the destination shape but not the source shape; and sending instructions to clear pixel values associated with the pixels.

Destination update for blending modes in a graphics pipeline

A method is disclosed for receiving a synchronization signal from a display circuit configured to display a series of frames, each frame comprising a plurality of tiles of pixels, determining, based on the received synchronization signal, that the display circuit has consumed data corresponding to one or more tiles of a frame, identifying a predetermined number of tiles that are subsequent to the one or more tiles consumed by the display circuit based on the synchronization signal, determining that one or more tiles of the identified tiles require an update, selectively rendering the determined tiles, and transmitting the rendered tiles to the display circuit.

Partial rendering and tearing avoidance

In one embodiment, a method includes by one or more computing devices, accessing an image including a hand of a user of a head-mounted display at a first time. The method includes generating, from at least the image, a virtual object representation of the hand, defined in a virtual environment that includes at least one other virtual object. The method includes rendering a first image of the virtual environment comprising a first portion of the hand of the user at a first frame rate, and determining a second viewpoint of the user at a second time. The method includes rendering a second image of the virtual environment comprising a second portion of the hand of the user at a second frame rate. The method includes providing, to a set of light emitters of the head-mounted display, instructions to display the second image.

Occlusion of virtual objects in augmented reality by physical objects

In particular embodiments, a computing system of a device may determine a display peak power budget allocated for a display component of the device. The system may determine display information including display workload and display telemetry associated with the display component. The system may determine, in accordance with a display peak power management policy applied to the display peak power budget and the display information, one or more display-controlling parameters for maintaining the display component to operate within the display peak power budget. The system may determine, based on the one or more display-controlling parameters, a plurality of grayscales for a plurality of regions on a display screen of the device. The system may adjust a rendered frame based on the plurality of grayscales and output the adjusted rendered frame on the display screen of the device.

Display peak power management for artificial reality systems

This disclosure describes efficient communication of surface texture data between system on a chip (SOC) integrated circuits. An example system includes a first integrated circuit and a second integrated circuit communicatively coupled to the first integrated circuit by a video communication interface. The first integrated generates a superframe in a video frame of the video communication interface for transmission to the second integrated circuit. The superframe includes multiple subframe payloads that carry surface texture data to be updated in the frame and corresponding subframe headers that include parameters of the subframe payloads. The second integrated circuit includes a direct access memory (DMA) controller. The DMA upon receipt of the superframe, writes the surface texture data within each of the subframe payloads directly to an allocated location in memory based on the parameters included in the corresponding one of the subframe headers.

Artificial reality system using superframes to communicate surface data

In one embodiment, one or more computing devices access an image comprising at least a portion of a hand of a user of a head-mounted display and generate a planar representation of the hand and a height map associated with the planar representation. A first portion of the planar representation that is closer than a first portion of a virtual object to a viewpoint and a second portion of the planar representation that is farther than a second portion of the virtual object from the viewpoint is determined based on the height map and the virtual object. A display image is rendered from the viewpoint for display, the display image comprising a first set of pixels corresponding to the first portion of the planar representation and a second set of pixels corresponding to the second portion of the virtual object.

This disclosure describes efficient communication of surface texture data between system on a chip (SOC) integrated circuits. An example system includes a first integrated circuit, and at least one second integrated circuit communicatively coupled to the first integrated circuit by a communication interface. The first integrated circuit, upon determining that surface texture data of a frame to be rendered for display by the second SoC integrated circuit is to be updated, (a) transmits the surface texture data in one or more update packets to the second integrated circuit using the communication interface, and (b) transmits a command to the second integrated circuit indicating that the surface texture data of the frame has been updated using the communication interface. The second integrated circuit, upon receipt of the command, (a) sets a pointer to a location in the display buffer storing the surface texture data of the frame, and (b) renders the surface texture data of the frame for display on a display device.

Artificial reality system using a multisurface display protocol to communicate surface data

In one embodiment, a method includes by one or more computing devices, accessing an image including a hand of a user of a head-mounted display. The method includes generating, from at least the image, a virtual object representation of the hand. The virtual object representation is defined in a virtual environment. The method includes rendering, based on the virtual object representation and at least one other virtual object in the virtual environment, an image of the virtual environment from a viewpoint of the user. The image includes a set of pixels that corresponds to a portion of the virtual object representation that is visible from the viewpoint of the user. The method includes providing, to a set of light emitters of the head-mounted display, instructions to display the image. The set of pixels in the image causes the light emitters at one or more positions to be unilluminated.

A system for distance calculation is disclosed. The system includes an illuminator unit, one or more camera units, and a distance processor. The illuminator unit illuminates a scene in a target area using a textured pattern creator and wherein the textured pattern creator includes a diffractive optical element. The one or more camera units captures two or more images of the target area from two or more physical locations. A textured pattern illumination is visible in each of the two or more images of the target area. The images are used to calculate distances to one or more points in the scene in the target area.

Enhancing stereo depth measurements with projected texture

A device for mapping and demapping cells in an orderly manner is provided. The device employs a channel identifier and in certain configurations a buffer and series of stages to provide for relatively ordered, predictable mapping and demapping of data, such as virtual concatenation data.

Control mechanism for mapping cells and packets

A memory is divided into a number of partitions. The partitions are grouped into a first group of partitions and a second group of partitions. When required by a port, a partition is assigned to the port from a pool of un-assigned partitions. The pool of un-assigned partitions comprises of un-assigned partitions from the first group of partitions and un-assigned partitions from the second group of partitions. The un-assigned partitions from the first group of partitions are assigned to the port until a first threshold is reached. The un-assigned partitions from the second group of partitions are assigned to the port after the first threshold is reached. A second threshold is used to limit a total number of partitions assigned to the port.

Dynamic memory allocation for assigning partitions to a logical port from two groups of un-assigned partitions based on two threshold values

A device to spatially and temporally reorder data a processor, memory and peripherals. This device is able to spatially and temporally reorder data for both write and read operations to and from memory, peripherals and a processor. This device uses a peripheral write path spatial reordering unit and a peripheral write temporal reordering unit to reorder data transmitted to peripherals and the memory. Further, this device users a peripheral read data path spatial reordering unit to reorder data read from peripheral devices. In addition, a main memory spatial reordering unit is utilized to reorder data read from main memory.

Device for spatially and temporally reordering for data between a processor, memory and peripherals

A method and apparatus for improving read latency for processor to system memory read transactions is disclosed. One embodiment of a system logic device includes logic that assumes a transfer size of a predetermined length. In this manner, the system logic device can issue a read transaction request to system memory as soon as the read request address is delivered by the processor rather than waiting for the processor to deliver information indicating the transfer length. Once the actual transfer length information is delivered from the processor to the system logic device, the system logic device determines whether any of the data returned by the system memory needs to be purged before returning the requested data to the processor.

Growing community of inventors

San Francisco, CA, United States of America

Steve John Clohset