The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 28, 2021
Filed:
Aug. 11, 2017
Twitter, Inc., San Francisco, CA (US);
Zhiyong Xie, San Francisco, CA (US);
Yue Lu, Redwood City, CA (US);
Pengjun Pei, Santa Clara, CA (US);
Gary Lam, Millbrae, CA (US);
Shuanghong Yang, Fremont, CA (US);
Yong Wang, Millbrae, CA (US);
Ziqi Huang, Mountain View, CA (US);
Xiaojiang Guo, Los Altos, CA (US);
Van Lam, New York City, NY (US);
Lanbo Zhang, Millbrae, CA (US);
Bingjun Sun, Los Altos, CA (US);
Sridhar Iyer, Sunnyvale, CA (US);
Sandeep Pandey, San Francisco, CA (US);
Qi Li, Foster City, CA (US);
Dong Wang, Palo Alto, CA (US);
Twitter, Inc., San Francisco, CA (US);
Abstract
An example system includes prediction workers, training workers, and a parameter server. The prediction workers store a local copy of a machine-learned model and run the mode exclusively in serving mode. The training workers store a local copy of a machine-learned model and a local snapshot and run the local copy exclusively in training mode and compare the local model or state to the snapshot after training to send delta updates to the parameter server after training. The parameter server aggregates received delta updates into a master copy of the model, sends the aggregated updates back to training workers and provides two types of updates; a real-time update based on a comparison of the master model with a local snapshot, and a full update. The real-time update occurs at least an order of magnitude more frequently than the full update and includes a subset of the weights in the model.