Microsoft Technology Licensing, LLC

Qiang Xiao

Jun Shi

Haichao Wei

Huiji Gao

In an example, a particular type of deep learning model is used in the global model of the GDMix model: a Factorization Machine. A Factorization Machine combines a Support Vector Machine (SVM) and Matrix Factorizations. It has the advantage of modeling data with huge sparsity well, while maintaining a linear time complexity. A modification may be further made to the Factorization Machine by introducing Lnorm reduction. This acts to divide calculations made by the Factorization Machine into a portion that can be precomputed and a portion that cannot be precomputed. The portion that can be precomputed is then precomputed in an offline manner. As such, when the model is operated in an online manner, the Factorization Machine only needs to compute the portion that cannot be precomputed, reducing the number of operations that need to performed at runtime and greatly improving processing speed over prior machine learned models.

Growing community of inventors

Sunnyvale, CA, United States of America

Qiang Xiao