Microsoft Technology Licensing, LLC

Kirill Sergeyevich Lebedev

Xiaoxu Wu

Vivek Tiwari

Alexandros Ntoulas

Alex S Kaufman

Jialiang Mao

Mahesh Gupta

Zhenrong Qian

Elise Georis

Wanjun Liu

Devang Jaysinh Negandhi

Sanjay Bysani

Technologies for on-device experimentation include embodiments that receive a request to provide digital content for display in a slot of a user interface display screen of a first device. By a secure execution environment, an identifier received with the request is anonymized. The request is determined to be associated with a content distribution test. The anonymized identifier is assigned to a test group associated with the content distribution test. The secure execution environment receives user interface event data generated by the first device in response to the content distribution test. The received user interface event data is attributed to the test group. An association of the user interface event data with the test group and the content distribution test is provided by the secure execution environment to a second device different than the first device while the identifier and the anonymized identifier are not provided to the second device.

On-device experimentation

A method and system for reviewing edits and editing content items are provided. An edit to a first version of a first content item is received. The first version of the first content is part of the active content delivery campaign and has been delivered over a computer network to a first plurality of computing devices. The edit is stored in a first storage that is separate from a second storage. An event indicating the edit is inserted into an event processing system. A result approving the edit is received from the event processing system. In response to receiving the result approving the edit, a second version is caused to be stored in the second storage. The second version reflecting the edit is caused to be delivered over the computer network.

Editing mechanism for electronic content items

Techniques for efficiently detecting similarity among electronic content items are provided. A vector is generated for each of multiple content items and is used to assign its corresponding content item to a group among multiple groups. A set of content items that is assigned to a particular group of the plurality of groups is identified. For each pair of content items in the set, a similarity score is generated and used to determine whether to classify the pair as similar to each other. Similarity data is updated if to identify the pair if it is determined to classify the pair of content items as similar to each other. The similarity data associates a first content item with a second content item. The second content item is prevented from being presented to a particular user for a period of time after the first content item is presented to the particular user.

Content item similarity detection

Growing community of inventors

Sunnyvale, CA, United States of America

Kirill Sergeyevich Lebedev