Microsoft Technology Licensing, LLC

Bin Wu

Weidong Zhang

Weiqin Ma

Wenxuan Gao

Yi Zheng

Yongzheng Zhang

Chi-Yi Kuan

Yurong Shi

SangHyun Park

Hong Lu

Liwen Zhang

Srihari R Duddukuru

The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of records from a set of inputs, with each record containing an entity key, a partition key, and one or more attribute-value pairs. Next, the system sorts and indexes the records by the entity key for each partitioned input. The system then processes a query of the records by matching entity key values to the sorted and indexed records for each input partition in the query. Next, the system merges the subset of records with the same entity key values into records, with each merged record containing an entity key field and a single field that includes a list of attribute-value pairs from the subset. Finally, the system outputs the merged records in response to the query.

Efficient merging and filtering of high-volume metrics

The disclosed embodiments provide a system for processing data. During operation, the system obtains a first configuration for processing a first set of content items from a first data source and a second configuration for processing a second set of content items from a second data source. For each content item in the first set of content items, the system uses mappings from the first configuration to transform original fields from the content item into required fields in a record representing the content item. Next, the system generates, from the required fields, a document key for the content item. The system also performs deduplication of multiple records with the document key and stores a single record with the document key. Finally, the system uses the second configuration to generate, from the second set of content items, a set of records independently of processing the first set of content items.

Scalable processing of heterogeneous user-generated content

Methods, systems, and computer programs are presented for selecting a title for a post of a social network. A method includes operations for identifying a word weight for each word in a corpus based on the relevance of each word, receiving a document that includes several sentences, and assigning to each word in the sentences a tag indicative of a part of speech. Further, the method includes operations for calculating a topic weight for each sentence based on the tags of the words in the sentence, and for calculating a sentence weight for each sentence based on a sum of the word weights of the words in the sentence, the topic weight for the sentence, and a position weight of the sentence within a paragraph. The sentence with the highest sentence weight is selected as the title for the document, and the title is presented with the document to a user.

Title extraction using natural language processing

Growing community of inventors

Palo Alto, CA, United States of America

Bin Wu