Amazon Technologies, Inc.

Kaiwen Qu

Fusheng Yuan

Ning Liao

Ruiwen Zhao

Josef Schiefer

Michael Banfield

Karishma Chawla

Douglas Stewart Laurence

Sameer Choudhary

Karmveer Veer Singh

John Pender

Milos Faro

An object data store may generate metadata responsive to a request that causes a scan of a data object for subsequent use in performing queries to the data object. A request may be received that causes a scan operation of the data object. As part of performing the scan one or multiple types of metadata describing the data object may be generated. The generated metadata may be applied to access the data object and perform a subsequently received query to the data object at the object data store.

Generating metadata from a scan of a data object in an object store for performing subsequent queries to the data object

Unstructured data items are stored at an object storage service. A filtering requirement to be used to generate a result set for an access request is determined. Using a transformed representation of the filtering requirement, a target set of tokens of the filtering requirement which are to be obfuscated within a log record is identified. A log record that comprises substitute tokens for the target set of tokens is generated and stored.

Masking sensitive information in records of filtered accesses to unstructured data

Unstructured data items are stored in an item collection. An access request comprising an input interpretation rule and a filtering criterion is directed to at least a portion of the item collection. Records are extracted from an unstructured data item using the input interpretation rule. A response to the access request is obtained, based at least partly in a determination that one of the records satisfies the filtering criterion.

Server-side filtering of unstructured data items at object storage services

Unstructured data items are stored at an object storage service. A filtering criterion to be used to generate a result set for an access request is determined. A test that can be used to determine, without completing parsing of a record identified in an unstructured data item, whether the record satisfies the filtering criterion is identified. Parsing of a particular record is abandoned in response to determining, using the test, that the record satisfies the filtering criterion. A response to the access request is determined using a subset of records that satisfy the filtering criterion.

Filtering pipeline optimizations for unstructured data

Growing community of inventors

Seattle, WA, United States of America

Kaiwen Qu