The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 02, 2022
Filed:
Sep. 06, 2019
Applicant:
Tata Consultancy Services Limited, Mumbai, IN;
Inventors:
Assignee:
TATA CONSULTANCY SERVICES LIMITED, Mumbai, IN;
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2022.01); G06N 3/08 (2006.01); G06N 3/04 (2006.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06N 3/0454 (2013.01);
Abstract
Implementations of the present disclosure build a Bayesian student network using the knowledge learnt by an accurate but complex pre-trained teacher network, and sparsity induced by the variational parameters in a student network. Further, the sparsity inducing capability of the teacher on the student network is learnt by employing a Block Sparse Regularizer on a concatenated tensor of teacher and student network weights. Specifically, the student network is trained using the variational lower bound based loss function, constrained on the hint from the teacher, and block-sparsity of weights.