Facebook, Inc.

Interana, Inc.

Scuba Analytics, Inc.

Lior Abraham

Robert Johnson

Don Fossgreen

Boris Dimitrov

Oleksandr Barykin

Ann Johnson

Peter Xiu Deng

Arieh Steinberg

Thomas Scott Whitnah

Alex Suhan

Josh Metzler

A method for enhancing rapid data analysis includes receiving a set of data; storing the set of data in a first set of data shards sharded by a first field; and identifying anomalous data from the set of data by monitoring a range of shard indices associated with a first shard of the first set of data shards, detecting that the range of shard indices is smaller than an expected range by a threshold value, and identifying data of the first shard as anomalous data.

Methods for enhancing rapid data analysis

A method for rapid data analysis includes receiving and interpreting a first query operating on a first dataset partitioned into shards by a first field; collecting a first data sample from a first set of data shards; calculating a first result to the first query based on analysis of the first data sample; and partitioning a second dataset into shards by a second field based on the first result.

Systems and methods for rapid data analysis

An external system (e.g., a website) is associated with an event and includes an interface that allows users to interact with streams of content associated with a social networking system. The interface allows a user to provide posts about the event via the interface, where the posts are displayed in the interface and also in a social networking interface on social networking system in connection with the user and other users associated with that user. The user can view, via the interface on the external system, posts from all users that are provided via the interface (e.g., everyone watching the event), thereby increasing the likelihood that the posts are relevant to the event. The user can also view, via the interface, posts from users associated with the user via the social networking system (e.g., friends of the user), regardless of where those are posted.

Interface for sharing posts about a live online event among users of a social networking system

A method for rapid data analysis comprising receiving and interpreting a query, collecting a first data sample from the first set of data shards, calculating an intermediate result to the query based on analysis of the first data sample, identifying a second set of data shards based on the intermediate result, collecting a second data sample from the second set of data shards, and calculating a final result to the query based on analysis of the second data sample.

Techniques provided herein allow for management of data. In various embodiments, systems and methods prune and retain data being managed by a data management system, where the managed data can include log data aggregated from one or more servers for analysis purposes. According to some embodiments, pruning can be triggered according to one or more constraints, such as the age of managed data (e.g., retain only 30 days of managed data) or the memory space required to store the managed data (e.g., retain only 100 GB worth of managed data). The constraints that trigger data pruning can be based on a data retention policy. When triggered, pruning can be performed on a fraction of the managed data stored based on the data retention policy (e.g., 3 days of full managed data, 27 days of pruned managed data). The pruning may be performed by sampling, at a desired rate, the managed data.

Growing community of inventors

San Francisco, CA, United States of America

Lior Abraham