International Business Machines Corporation

Lenovo (singapore) Pte. Ltd.

Mark Andrew Smith

Mark L Yakushev

Daniel Gruhl

Jan Hendrik Pieper

Ryan John Minniear

David Maxwell Cannon

Bernhard Julius Klingenberg

David Allan Pease

Clemens Drews

Benjamin Clay Reed

Karen Wolfe Brannon

Sangeeta T Doraiswamy

Wenling Cai

Sandeep Madhav Uttamchandani

Nagapramod S Mandagere

Pin Zhou

Taiga Nakamura

John C Tang

Aly Megahed

Neeta Garimella

Kugamoorthy Gajananan

Anurag Sharma

Hamid Reza Motahari Nezhad

Peifeng Yin

Shubhi Asthana

Eben Merriam Haber

Christopher Scott Long

Described are a method, system, and computer program product for deduplicating a storage object. A hash of a window of data of a storage object is determined and a determination is made as to whether the window of data of the storage object corresponds to a chunk boundary. A determination is made as to whether the hash of the object matches one pseudo fingerprints in a list of at least one pseudo fingerprint. A storage object chunk boundary based on the window of data is stored in response to the window of data corresponding to the chunk boundary or in response to determining that the hash of the object matches one of the pseudo fingerprints. A determination is made of a new window of data in the storage object following the window of data when the window of data is not an end of data of the storage object.

Determining chunk boundaries for deduplication of storage objects

A system for cognitive assessment of the competitiveness of deals may include a memory having stored thereon historical deal information for historical deals with each historical deal including a historical deal component. A historical deal component may include a historical work scope and associated historical work pricing. The system may also include a processor cooperating with the memory and configured to compare current deal information with the historical deal information. The current deal information may include a current deal component that may include a current work scope and associated current work pricing. The processor may use machine learning to determine whether the current deal component is non-competitive based upon the historical deal information, and for each non-competitive current deal component generate an alternative current deal component. The alternative current deal component may have at least one of a different current work scope and different associated current work pricing.

System for cognitive assessment of transactions

Described are a method, network system, and computer program product for deduplication of storage objects in a network. A hash of a window of data of a storage object is determined and a determination is made as to whether the window of data of the storage object corresponds to a chunk boundary. A determination is made as to whether the hash of the object matches one pseudo fingerprints in a list of at least one pseudo fingerprint. A storage object chunk boundary based on the window of data is stored in response to the window of data corresponding to the chunk boundary or in response to determining that the hash of the object matches one of the pseudo fingerprints. A determination is made of a new window of data in the storage object following the window of data when the window of data is not an end of data of the storage object.

Determining chunk boundaries for deduplication of storage objects in a network computing environment

Embodiments of the invention relate to a virtual file system for communicating changes in metadata associated with data archived in a data storage system to applications. An aspect of the invention concerns a system that comprises a virtual file system for storing metadata files wherein each metadata file is associated with an archived data file, and a virtual file system interface coupled to the virtual file system for exposing changes in the metadata files to the applications.

Virtual file system interface for communicating changes of metadata in a data storage system

Provided are a computer program product, system, and method for identifying modified chunks in a data set for storage. Information is maintained on a data set of variable length chunks, including a digest of each chunk and information to locate the chunk in the data set. Modifications are received to at least one of the chunks in the data set. A determination is made of chunks including data affected by the modifications. The determined chunks including data affected by the modifications are processed to determine new chunks and for each determined new chunk and for each determined new chunk, new digest information of the new chunk. The new digest information on the at least one new chunk and information to locate the new chunk in the data set are added to the set information.

Identifying modified chunks in a data set for storage

Described are embodiments of an invention for identifying chunk boundaries for optimization of fingerprint-based deduplication in a computing environment. Storage objects that are backed up in a computing environment are often compound storage objects which include many individual storage objects. The computing device of the computing environment breaks the storage objects into chunks of data by determining a hash value on a range of data. The computing device creates an artificial chunk boundary when the end of data of the storage object is reached. When an artificial chunk boundary is created for the end of data of a storage object, the computing device stores a pseudo fingerprint for the artificial chunk boundary. If a hash value matches a fingerprint or a pseudo fingerprint, then the computing device determines that the range of data corresponds to a chunk and the computing system defines the chunk boundaries.

Optimization of fingerprint-based deduplication

The present invention provides a method and system of performing de-duplication for at least one computer file in a computer system. In an exemplary embodiment, the method and system include (1) tuning a rolling-hash algorithm for the de-duplication, (2) chunking the data in the file into chunks of data by using the tuned algorithm, (3) producing a content identifier for each of the chunks, and (4) processing the chunks that are unique, the content identifier for each of the chunks that are unique, and references to the chunks that are unique. In an exemplary embodiment, the computer system includes a de-duplication-enabled data store. In an exemplary embodiment, the computer system includes (a) a transferor computer system that is configured to transfer the file to a de-duplication-enabled computer system and (b) the de-duplication-enabled computer system.

Tunable data fingerprinting for optimizing data deduplication

The present invention provides a method and system of receiving data in a data store in a server computer system. In an exemplary embodiment, the method and system include (1) receiving client authentication information of a client computer system, (2) receiving a data signature of the data from the client computer system, and (3) attempting to locate in the data store at least one data chunk with a stored data signature equal to the received data signature.

Optimizing a data deduplication system using client authentication information

Provided are a computer program product, system, and method for identifying modified chunks in a data set for storage. Information is maintained on a data set of variable length chunks, including a digest of each chunk and information to locate the chunk in the data set. Modifications are received to at least one of the chunks in the data set. A determination is made of at least one range of least one of the chunks including data affected by the modifications, wherein each range identifies one chunk or sequential chunks having data affected by the modifications. The at least one chunk in each range is processed to determine at least one new chunk in each range, and for each determined new chunk, a digest of the new chunk. A determination is made as to whether at least one chunk outside of the at least one range has changed. For each determined at least one chunk outside of the at least one range that has changed, a determination is made of at least one new chunk and a new digest of the at least one new chunk. Adding to the set information the new digest information on the at least one new chunk and information to locate the new chunk in the data set.

Embodiments of the invention relate to creating an operating system and file system independent incremental data backup. A first data backup of a source system and second version of the data on the source system is received. A second data backup of the second version of the data is created by determining differences between the first data backup and the second version of the data. Each portion of the second version of the data that is the same as a portion of the first data backup is referenced in the second data backup. Each portion of the second version of the data that is different than all portions of the first data backup is included in the second data backup. The second data backup is appended to the first data backup to create an incremental data backup.

Operating system and file system independent incremental data backup

Processing archive content based on hierarchical classification levels is performed by indexing a first newly archived file of a current set of archive content at a first classification level defining a plurality of types of metadata to be derived, wherein the first classification level is selected from a hierarchy of classification levels having at least two classification levels, indexing a second newly archived file of the current set of archive content at a second classification level, wherein the second classification level includes fewer types of metadata than the first class of metadata, and flagging the second newly archived file of the current set of archive content. By classifying and flagging the second newly archived file differently than the first newly archived file, the system can easily retrieve such data at a later instance to update and/or change the data, re-index the data, and the like.

Processing archive content based on hierarchical classification levels

Provided are a computer program product, system, and method for identifying modified chunks in a data set for storage. Modifications are received to at least one of the chunks in the data set. A determination is made of at least one range of least one of the chunks including data affected by the modifications determination is made as to whether at least one chunk outside of the at least one range has changed. For each determined at least one chunk outside of the at least one range that has changed, a determination is made of at least one new chunk and a new digest of the at least one new chunk and information is added on the at least one new chunk and information to locate the new chunk in the data set.

The present invention provides a method and system of backing up a de-duplicated computer file-system of a computer system. In an exemplary embodiment, the method and system include (1) dividing the file-system into partitions and (2) storing each of the partitions on a separate storage medium.

Growing community of inventors

Los Gatos, CA, United States of America

Mark Andrew Smith