Facebook, Inc.

Dmytro Dzhulgakov

Lars Seren Backstrom

Stuart Michael Bowers

Ou Jin

Andrew John Tulloch

Uladzimir Pashkevich

The present disclosure is directed to a high-capacity training and prediction machine learning platform that can support high-capacity parameter models (e.g., with 10 billion weights). The platform implements a generic feature transformation layer for joint updating and a distributed training framework utilizing shard servers to increase training speed for the high-capacity model size. The models generated by the platform can be utilized in conjunction with existing dense baseline models to predict compatibilities between different groupings of objects (e.g., a group of two objects, three objects, etc.).

High-capacity machine learning system

When an online system receives a request to present content items to a user, a content selection system included in the online system selects content items for presentation to the user during a latency period from the time the request was received until the time when the content items are sent. A feedback control mechanism communicates with each computing device of the content selection system to determine the latency period of each computing device. The feedback control mechanism also determines a target latency period in which content items are selected. By comparing the latency period of each computing device to the target latency period, an amount of information to be evaluated by each computing device is determined based on whether a computing device's latency period is greater than or less than the target latency period.

Growing community of inventors

Menlo Park, CA, United States of America

Dmytro Dzhulgakov