Rambus Inc.

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Csr Technology Inc.

Vlad Fruchter

Keith Lowery

Ohad Meitav

Steven Cameron Woo

David Vakrat

Ronald Lee

Richard Lawrence Greene

Hideo Tamama

George Michael Uhler

Chi-Ming (Philip) Yeung

Wayne Frederick Ellis

Lawrence Lai

Liji Gopalakrishnan

Pradeep Batra

Chi-Ming Yeung

Andrey Tovchigrechko

Frederick Abbott Ware

Oscar Ayzenberg

Shrirang Madhav Yardi

Javid Jaffari

Bardia Zandian

Nishant Sitapara

Jeremy Snodgrass

A method of processing memory instructions including receiving a memory related command from a client system in communication with a memory appliance via a communication protocol, wherein the memory appliance comprises a processor, a memory unit controller and a plurality of memory devices coupled to said memory unit controller. The memory related command is translated by the memory appliance into a plurality of primitive commands that are lower level commands and formatted to perform prescribed data manipulation operations on data of the plurality of memory devices stored in data structures. The plurality of primitive commands is executed on data stored in the memory devices to produce a result, wherein the executing is performed by the memory controller. A direct memory transfer of the result is established over the communication protocol to a network.

High level instructions with lower-level assembly code style primitives within a memory appliance for accessing memory

A method for obtaining multiple frames of image data includes obtaining a first frame of image data of an entirety of a field of view by a camera sensor. The method also includes defining one or more regions of the field of view using the first frame of image data. The method includes determining at least one of a frame rate and an image capture resolution for each of the one or more regions. The method includes operating the camera sensor to obtain partial frames of image data by obtaining image data of the one or more regions of the field of view according to at least one of the frame rate and the image capture resolution, and re-constructing one or more full frames from partial frames of image data.

Systems and methods for dynamic image processing and segmentation

System and method for improved transferring of data involving memory device systems. A memory appliance (MA) comprising a plurality of memory modules is configured to store data within the plurality of memory modules and further configured to receive data commands from the first server and a second server coupled to the MA. The data commands may include direction memory access commands such that the MA can service the data commands while bypassing a host controller of the MA.

Memory appliance couplings and operations

Systems and methods for peak power control include control circuitry which identifies a condition for a device. The control circuitry can apply the condition for the device to one or more models maintained for a plurality of device processing units of the device to determine one or more performance characteristics for the plurality of processing units. The control circuitry can distribute power credits to the plurality of device processing units of the device according to the determined performance characteristics for the plurality of device processing units, to manage a respective peak power for each respective device processing unit according to a number of the power credits distributed to the respective device processing unit.

Systems and methods for peak power control

A method of processing memory instructions including receiving a memory related command from a client system in communication with a memory appliance via a communication protocol, wherein the memory appliance comprises a processor, a memory unit controller and a plurality of memory devices coupled to said memory unit controller. The memory related command is translated by the processor into a plurality of commands that are formatted to perform prescribed data manipulation operations on data of the plurality of memory devices stored in data structures. The plurality of primitive commands is executed on data stored in the memory devices to produce a result, wherein the executing is performed by the memory unit controller. A direct memory transfer of the result is established over the communication protocol to a network.

In one embodiment, a system may include a memory unit, a first processing unit configured to write data into a memory region of the memory unit, a second processing unit configured to read data from the memory region, a first control unit configured to control the first processing unit's access to the memory unit and, and a second control unit configured to control the second processing unit's access to the memory unit. The first control unit may be configured to obtain, from the second control unit, a first memory address associated with a data reading process of the second processing unit, receive a write request from the first processing unit, the read request having an associated second memory address, and write data into the memory region based on the write request in response to a determination that the second memory address falls outside of the guarded reading region.

Systems and methods for efficient data buffering

In one embodiment, one or more control units may store a position tracker associated with a first window of memory blocks and allow a first processing unit to write data within the first window. The control units may receive, from a second processing unit, a request for reading data with a memory-reading address, compare the memory-reading address to a first starting address of the first window, and prevent the second processing unit from reading the data when the memory-reading address is greater than or equal to the first starting address of the first window. The control units may store, when the data writing process is complete, an updated position tracker of a second window of memory blocks and allow the second processing unit to read the data based on a determination that the memory-reading address is less than a second starting address of the second window.

In one embodiment, a system may include a memory unit, a first processing unit configured to write data into a memory region of the memory unit, a second processing unit configured to read data from the memory region, a first control unit configured to control the first processing unit's access to the memory unit and, and a second control unit configured to control the second processing unit's access to the memory unit. The second control unit may be configured to obtain, from the first control unit, a first memory address associated with a data writing process of the first processing unit, receive a read request from the second processing unit, the read request having an associated second memory address, and delay execution of the read request based on a comparison of the first memory address and the second memory address.

In one embodiment, a method includes accessing image-sensor data generated by the image sensor, where the image sensor has a color filter array with a pre-determined number of filter sets, and where each set of filters has a single color, splitting the image-sensor data into a pre-determined number of images, where each image corresponds to a portion of the image-sensor data associated with one of the sets of filters, compressing each of the images using an image compression algorithm, and sending the compressed images to a second computing device, where the second computing device is configured to create an output image based on the compressed images.

Image-sensor data compression

A special-purpose hardware device for mitigating motion-to-photon latency in head-mounted displays may include an image signal processor that receives at least one image frame captured by a camera device of a head-mounted-display system. The special-purpose hardware device may also include an input-formatting component that receives the computer-generated imagery. The special-purpose hardware device may further include a blending component that generates at least one mixed-reality frame by overlaying the computer-generated imagery onto the image frame. The special-purpose hardware device may additionally include a frame-output interface that feeds the mixed-reality frame generated by the blending component to a display device of the head-mounted-display system to facilitate displaying the mixed-reality frame for presentation to a user wearing the head-mounted-display system. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in headmounted displays

A special-purpose hardware device for achieving intraframe image processing in head-mounted displays may include an image-correction component that receives a single image frame destined to be displayed for presentation to a user wearing a head-mounted-display system. The image-correction component may also receive user-motion data indicating that the user wearing the head-mounted-display system has made at least one movement since generation of the single image frame. The image-correction component may further perform hardware-accelerated intraframe processing operations on the single image frame in accordance with the user-motion data to compensate for the movement made by the user on a line-by-line basis. In addition, the special-purpose hardware device may include a frame-output interface that feeds the single image frame to a display device of the head-mounted-display system to facilitate displaying the single image frame for presentation to the user. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays

The disclosed display device may include (1) a display panel including pixel regions, (2) a backlight array coupled to the display panel that includes luminous elements, (3) a display housing configured to substantially prevent a user from referencing external brightness levels, (4) a display driver configured to receive an image including image blocks and scan the image to the display panel, and (5) a backlight driver configured to (a) determine an absolute brightness level of each of the image blocks, (b) derive, for each of the image blocks, a relative brightness level, (c) calculate, for each of the luminous elements, an illumination level based on the relative brightness level of a corresponding portion of the image blocks, and (d) illuminate, while the image is displayed via the display panel, each of the luminous elements according to the illumination level. Various other apparatus, systems, and methods are also disclosed.

Apparatus, systems, and methods for local dimming in brightness-controlled environments

The disclosed special-purpose hardware device may include an image signal processor that receives, from a camera device of a head-mounted-display system, image frames of a physical environment. The special-purpose hardware device may also include a positional tracking component that (1) stores at least a portion of the image frames in a cache of the special-purpose hardware device that has a faster access speed than a main memory of the special-purpose hardware device, (2) tracks, based on the portion of the image frames stored in the cache, a change in the position of the head-mounted display system within the physical environment, and (3) stores the change in the position of the head-mounted-display system in the main memory for use in generating one or more augmented-reality frames. The special-purpose hardware device may further include a frame-output interface that feeds the augmented-reality frames to a display device of the head-mounted-display system.

Growing community of inventors

Los Altos, CA, United States of America

Vlad Fruchter