The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 21, 2026

Filed:

Feb. 28, 2023
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Ye Yu, Redmond, WA (US);

Gaurav Mittal, Redmond, WA (US);

Matthew Brigham Hall, Kenmore, WA (US);

Sandra Sajeev, Seattle, WA (US);

Mei Chen, Bellevue, WA (US);

Jialin Yuan, Corvallis, OR (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06V 10/80 (2022.01); G06F 40/284 (2020.01); G06V 10/75 (2022.01);
U.S. Cl.
CPC ...
G06V 10/811 (2022.01); G06F 40/284 (2020.01); G06V 10/75 (2022.01);
Abstract

A computerized method trains and uses a multimodal fusion transformer (MFT) model for content moderation. Language modality data and vision modality data associated with a multimodal media source is received. Language embeddings are generated from the language modality data and vision embeddings are generated from the vision modality data. Both kinds of embeddings are generated using operations and/or processes that are specific to the associated modalities. The language embeddings and vision embeddings are combined into combined embeddings and the MFT model is used with those combined embeddings to generate a language semantic output token, a vision semantic output token, and a combined semantic output token. Contrastive loss data is generated using the three semantic output tokens and the MFT model is adjusted using that contrastive loss data. After the MFT model is trained sufficiently, it is configured to perform content moderation operations using semantic output tokens.


Find Patent Forward Citations

Loading…