Apple Inc.

Walter A Talbott

Joshua M Susskind

Feng Tang

Nitish Srivastava

Hanlin Goh

Chen Huang

Shih-Yu Sun

Shuangfei Zhai

Attention-free transformers are disclosed. Various implementations of attention-free transformers include a gating and pooling operation that allows the attention-free transformers to provide comparable or better results to those of a standard attention-based transformer, with improved efficiency and reduced computational complexity with respect to space and time.

Attention free transformer

A facial recognition authentication process operating on a device may capture an image of a user using a camera on the device. The facial recognition authentication process may include operating a full face facial recognition authentication process on the captured image or operating a partial face facial recognition authentication process on the captured image. The process may determine which process to operate (either full face or partial face) based on an assessment of an amount of occlusion in the captured image. The partial face facial recognition authentication process may be operated when there is at least some occlusion of selected features (e.g., nose and/or mouth) on the user's face in the captured image.

Periocular facial recognition switching

Growing community of inventors

Cupertino, CA, United States of America

Walter A Talbott