Amazon Technologies, Inc.

Varad Gunjal

Ashwin Swaminathan

Raghavan Manmatha

Hao Yang

Siqi Deng

Ali Caner Turkmen

Matthaeus Kleindessner

Kailash Budhathoki

Christopher Michael Russell

The present disclosure generally relates to systems and methods for searching media content. In some implementation examples, a search system receives an input query, generates a query embedding of the input query, and generates a bias mitigation transformation associated with a sensitive attribute. Based on the query embedding and the bias mitigation transformation, the search system generates a transformed query embedding that suppresses at least a portion of the query embedding related to the sensitive attribute. Using the transformed query embedding, the search system executes a similarity search in a media embedding model to identify one or more media embeddings that are similar to the transformed query embedding and transmits the one or more media embeddings.

Mitigating bias in multimodal models via query transformation

Growing community of inventors

Brooklyn, NY, United States of America

Varad Gunjal