Lemon Inc.

Beijing Youzhuju Network Technology Co., Ltd.

Viacheslav Dubeyko

Jian Wang

Neema Mashayekhi

Cong Wang

The present disclosure describes techniques for improved data processing. At least one management page may be generated by a host. The at least one management page comprises a plurality of management structures, and the at least one management page defines data instances, algorithms, and a computational environment. Computation may be initiated in a memory pool by performing a write operation of the at least one management page into the memory pool. The memory pool comprises a persistent memory and a plurality of field-programmable gate array (FPGA) cores. The computation in the memory pool comprises parallel data processing by at least a subset of the plurality of FPGA cores.

Data processing using a heterogeneous memory pool

The present disclosure describes techniques for guaranteeing online services based on predicting failures of storage devices. Statistical data may be extracted on a regular basis by each of a plurality of storage devices. Each of the plurality of storage devices may comprise a set of NAND dies. Each of the set of NAND dies may be configured to measure and track a set of metrics indicating characteristics of each NAND die. Prediction data indicating potential failures of the plurality of storage devices may be generated. The prediction data may be shared with a host on a periodic basis. A strategy of decommissioning an aged storage device and adding a new storage device based on the prediction data may be created by the host. The data migration to the new storage device may be implemented.

Guaranteeing online services based on predicting failures of storage devices

The present disclosure describes techniques for implementing instant corruption detection and recovery. A plurality of streams may be created in a storage device. Each of the plurality of streams may contain a sequence of metadata nodes of a same type. Each of the plurality of streams may maintain an initial state, a sequence of delta modifications to the initial state, and an actual state for each of the sequence of metadata nodes. A checking and recovery function associated with a particular stream among the plurality of streams may be determined. The checking and recovery function may comprise checking logic configured to detect corruptions by checking modification operations associated with metadata nodes in the particular stream. The checking and recovery function may further comprise recovery logic configured to perform recoveries from the corruptions. The checking and recovery function associated with the particular stream may be implemented in the storage device.

Implementation of instant corruption detection and recovery

A system includes a first hardware architecture and computational storage. The computational storage includes a second hardware architecture, and memory storing instructions that, when executed by the second hardware architecture, causes the system to perform a first set of operations. The first set of operations include receiving instructions from the first hardware architecture, performing one or more computations on data stored in the second hardware architecture, based on the received instructions, and transmitting a result to the first hardware architecture, based on the one or more performed computations.

System for computational storage with hardware-assistance

The present disclosure describes techniques for offloading computation based on an extended instruction set architecture (ISA). The extended ISA may be created based on identifying functions executed multiple times by a central processing unit (CPU). The extended ISA may comprise hashes corresponding to the functions and identifiers of extended operations associated with the functions. The extended operations may be converted from original operations of the functions. The extended operations may be executable by a storage device. The storage device may be associated with at least one computational core. Code may be synthesized based at least in part on the extended ISA. Computation of the synthesized code may be offloaded into the storage device.

Offloading computation based on extended instruction set architecture

Techniques for improving performance of file system operations are provided. Dirty memory pages may be copied from a file system into a memory associated with a first hardware accelerator. Content of the memory pages may be compressed by one or more cores of the hardware accelerator. The compressed data may be compacted into a payload area of at least one log. Metadata of the at least one log may be prepared by the one or more cores of the hardware accelerator. The at least one log may be flushed into a storage device. A read operation may be performed on the at least one log. On a read path, in response to determining that a size of data from a plurality of logs is greater than a predetermined threshold, a new log may be created by combining the data using compression by a second hardware accelerator.

Performance of file system operations

The present disclosure describes techniques for offloading data processing and knowledge synthesis. A set of flags may indicate information about the memory pages in a first memory and may be manageable by at least one central processing unit (CPU). A memory page may be flushed to a second memory if the memory page is associated with a first flag. The first flag may indicate that the memory page is ready to be flushed to the second memory. The second memory may be configured to store a sequence of states of each of the memory pages. Data patterns and relations among the data patterns may be determined by data processing units (DPUs) based on the sequence of states of each of the memory pages. A knowledge base may be built in a third memory based on the data patterns and the relations among the data patterns.

Offloading data processing and knowledge synthesis

The present disclosure describes techniques for improving data processing. At least one transaction may be generated by a file system driver associated with a host. Each transaction comprises logical block addresses (LBAs) and information associated with at least one function. The at least one transaction may be journaled into a computational storage for offloading data processing from the host to the computational storage. The computational storage comprises a persistent memory and at least one field-programmable gate array (FPGA) core. The offloading of the data processing comprises offloading journal replay operations to the computational storage. The journal replay operations comprise applying the at least one function to at least one subset of the LBAs by the at least one FPGA core.

Offloading data processing into computational storage using journaling

The present disclosure describes techniques for accelerating data processing by offloading thread computation. An application may be started based on creating and executing a process by a host, the process associated with a plurality of threads. Creating a plurality of computation threads on a storage device may be requested based on determining that the storage device represents a computational storage. The plurality of computation threads may be created based on preloading a plurality of libraries in the storage device. The plurality of libraries may comprise executable codes associated with the plurality of threads. Data processing associated with the plurality of threads may be offloaded to the storage device using the plurality of computation threads. Activities associated with the plurality of computation threads may be managed by the process.

Accelerating data processing by offloading thread computation

A first combined key may be generated based on a geographic location, a first time, and a first user that are associated with a first event. The first combined key and first data indicating the first event may be stored in a database, the first combined key configured to identify the first data. A second combined key may be generated based on the geographic location, a second time, and a second user that are associated with a second event. The second combined key and second data indicating the second event may be stored in the database, the second combined key configured to identify the second data. A set of events associated with the geographic location and comprising the first event and the second event may be presented by retrieving the first data and the second data using the first combined key and the second combined key, respectively.

Data storage based on geographic location

The present disclosure describes techniques for implementing fast and reliable metadata operations. A metadata area instance may be created in a persistent memory associated with a host. The metadata area instance may comprise a first portion configured to store an initial state of metadata, a second portion configured to store an actual state of the metadata, and a third portion configured to store a plurality of modifications to the metadata. A main copy of the metadata may be generated by performing write operations in the metadata area instance. The main copy of the metadata may be updated based on receiving information indicative of a modification to the metadata.

Implementation of fast and reliable metadata operations

In a method for superposition of multiple commands, one or more memory pages is received. The one or more memory pages include information corresponding to one or more code lines and one or more data lines. The one or more code lines correspond to a first set of layers in a memory layer and are configured to execute one or more functions. The one or more data lines correspond to a second set of layers in the memory layer and are configured to store one or more sets of data. Each of the one or more code lines from the one or more memory pages is executed to perform one or more corresponding functions, based on the one or more data lines from the one or more memory pages. A result of each of the one or more functions is stored within the one or more data lines.

Method of superposition of multiple commands execution

The present disclosure describes techniques for accessing user accounts and data from any computing device. It may be determined whether an account of a user exists in a cloud service in response to receiving information associated with the user from any computing device. Data associated with the account may be stored by the cloud service. There may be a plurality of types of data associated with a plurality of security levels. The plurality of security levels may correspond to different security requirements. The data associated with the account may belong to at least one of the plurality of types of data. An instance of the account may be deployed to the computing device in response to determining that the account exists in the cloud service. The instance of the account may enable the user to access services via the computing device.

Accessing user accounts and data from any computing device

In a method for offloading data processing into computational storage, a request to offload data computation into computational storage is received. One or more transactions to encapsulate the request are prepared. One or more write requests are generated based on the one or more transactions, and the one or more transactions are stored into one or more journals. A set of transactions is extracted from the one or more journals. A subset of the set of transactions is received at an eBPF subsystem, where the subset corresponds to one or more computation requests. Information from a file is extracted, where the information corresponds to one or more logical block addresses (LBAs). The one or more computation requests are performed on the one or more LBAs using the subset of the set of transactions, and an indication corresponding to the performed computation requests is generated.

Growing community of inventors

Los Angeles, CA, United States of America

Viacheslav Dubeyko