Amazon Technologies, Inc.

Yuanjun Xiong

Wei Xia

Shuo Yang

Wei Li

Stefano Soatto

Yifan Xing

Meng Wang

Siqi Deng

Zheng Zhang

Joseph Patrick Tighe

Jonathan Wu

Jia Bi Zhang

Xiang Xu

Hao Zhou

Tong He

David Paul Wipf

Yantao Shen

Juan Pablo Escalona Garcia

Bing Shuai

Mingze Xu

Yongxin Wang

Tianjun Xiao

Techniques for liveness detection using a motion, face, and context cues. The techniques can be implemented to prevent against successful presentation attacks, video injection attacks, and deepfake attacks. In some examples, the techniques encompass receiving a set of video frames from a personal computing device. A first liveness determination can be made using a motion-based model based on the received video frames. A second liveness determination can be made using a face-based model based on the received video frames. A third liveness determination can be made using a context-based model based on the received video frames. A final liveness determination can be made based on the first, second and third liveness determinations.

Liveness detection based on motion, face, and context cues

Machine learning models may be generated that are compatible with another machine learning model and satisfy a resource constraint. Techniques that ensure weight compatibility and architectural compatibility between a machine learning model being created to be compatible with another machine learning model are applied. The resource constraint is enforced so that the generated machine learning model also fits within the resource constraint.

Compatible machine learning model generation within resource constraints

A machine learning model, such as a neural network, is partially encrypted with a homomorphic encryption scheme. Application of the machine learning model to data includes performing operations on plaintext and encrypting results of operations for input to other operations that are performed over cyphertext. Ciphertext output of such operations can be provided to a service that is able to decrypt the ciphertext output.

Encrypted machine learning models

Techniques for performing visual clustering with a hierarchical graph neural network framework including a joint linkage prediction and density estimation graph model are described. Embodiments herein recurrently run the joint linkage prediction and density estimation graph model to generate intermediate clusters in multiple iterations (e.g., until convergence) to obtain a final clustering result. In certain embodiments, for each iteration, the input graph contains nodes that are merged from nodes assigned to intermediate clusters from the previous iteration. By using a small and fixed bandwidth k in each iteration, embodiments herein alleviate the sensitivity to the k selection for different clustering applications. Certain embodiments herein remove the tuning of a different k (e.g., k-bandwidth) for k-nearest neighbor graph construction over different clustering applications.

Hierarchical graph neural networks for visual clustering

An image may be evaluated by a computer vision system to determine whether it is fit for analysis. The computer vision system may generate an embedding of the image. An embedding quality score (EQS) of the image may be determined based on the image's embedding and a reference embedding associated with a cluster of reference noisy images. The quality of the image may be evaluated based on the EQS of the image to determine whether the quality meets filter criteria. The image may be further processed when the quality is sufficient, or otherwise the image may be removed.

Methods and systems for performing noise-resistant computer vision techniques

Techniques for data synthesis for training datasets for machine learning applications are described. A first image of at least an object from a first viewpoint is obtained. The first image having associated first image metadata including a first location of a feature of the object in the first image. A model is generated from the first image, the model including a three-dimensional representation of the object. A second image is generated from the model, the second image including the object from a second viewpoint that is different from the first viewpoint. Second image metadata is generated, the second image metadata including a second location of the feature of the object in the second image, the second location corresponding to the first location adjusted for the difference between the second viewpoint and the first viewpoint.

Data synthesis using three-dimensional modeling

Techniques for building a backward compatible and backfill-free image search system are described. According to some embodiments, a backwards compatible training system trains a new embedding model to be backward compatible with the face embeddings (e.g., floating-point vectors) generated by a previous embedding model. In one embodiment, backwards compatible training uses a classifier of the previous embedding model as a form of constraint in the training of the new embedding model.

Backward compatible and backfill-free image search system

Growing community of inventors

Seattle, WA, United States of America

Yuanjun Xiong