The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 31, 2023
Filed:
Oct. 15, 2019
Zoox, Inc., Foster City, CA (US);
Shimin Guo, San Mateo, CA (US);
Ethan Miller Pronovost, San Mateo, CA (US);
Connor Jonathan Soohoo, Redwood City, CA (US);
Qijun Tan, San Mateo, CA (US);
Zoox, Inc., Foster City, CA (US);
Abstract
Techniques for training a machine learning model are described herein. For example, the techniques may include implementing a cross batch normalization layer that generates a cross batch normalization layer output based on a first layer output during training of the neural network. The training may be based on a local batch of training examples of a global batch including the local batch and at least one remote batch of training examples. The cross batch normalization layer output may include normalized components of the first layer output determined based on global normalization statistics for the global batch. Such techniques may be used to train a neural network over distributed machines by synchronizing batches between such machines.