Snap Inc.

Farid Zare Seisan

Dmitry Ryuma

Ulf Oscar Michel Loenngren

Jennica Pounds

Bernhard Jung

Dominik Schnitzer

Daniel Colascione

Daniel Harris

Olivier Slabbert Schonken

Andrzej Bylicki

Aidan Rogers

Liviu Marius Coconu

Mihajlo Marinkovic

Ola Jeppsson

A head-wearable apparatus includes a frame having a front piece configured to hold left and right lenses. A left temple is coupled to the front piece and a right temple coupled to the front piece. A camera system includes one or more cameras coupled to the front piece, one or more left peripheral cameras coupled to an outside surface of the frame, and one or more right peripheral cameras coupled to an outside surface of the frame. A left peripheral display is coupled to an inside surface of the frame. The left peripheral display is configured to receive and display input from the one or more left peripheral cameras. A right peripheral display is coupled to an inside surface of the frame. The right peripheral display is configured to receive and display input from the one or more right peripheral cameras.

Recreating peripheral vision on a wearable device

A multi-System on Chip (SoC) hand-tracking platform is provided. The multi-SoC hand-tracking platform includes a computer vision SoC and one or more application SoCs. The computer vision SoC hosts a hand-tracking input pipeline. The one or more application SoCs host one or more applications that are consumers of input event data generated by the hand-tracking input pipeline. The applications communicate with some components of the hand-tracking input pipeline using a shared-memory buffer and with some of the components of the hand-tracking input pipeline using Inter-Process Communication (IPC) method calls.

Multi-SoC hand-tracking platform

Systems and methods herein describe an actuator control system for controlling intelligent actuated temple tips of a pair of eyeglasses. The actuator control system receives a set of measurements corresponding to a length of eyeglass temple tips on a pair of eyeglasses, receives, from a user of the pair of eyeglasses, user feedback corresponding to a position of the eyeglass temple tips, generating a predicted set of measurements for the length of the eyeglass temple tips using a machine learning model, and transmits the predicted set of measurements to pneumatic actuators coupled to the eyeglass temple tips.

Intelligent actuated temple tips

Systems and methods herein describe a media capture system that receives sensor data from biometric sensors coupled to a head-wearable apparatus, detects a trigger event corresponding to a user of the head-wearable apparatus based on the sensor data, captures images using a camera coupled to the head-wearable apparatus, and transmits the captured images to a client device.

Automatic media capture using biometric sensor data

Systems and method describe an actuator control system for controlling an intelligent actuated nose bridge on a pair of wearable glasses. The actuator control system receives a set of measurement data corresponding to a length of the nose bridge, generates a predicted set of measurement data for the length of the nose bridge, transmits the predicted set of measurement data to pneumatic actuators coupled to the nose bridge, captures a first set of images of the nose bridge, generates an augmented set of measurement data for the nose bridge, generates an adjusted set of measurement data based on the predicted set of measurement data and the augmented set of measurement data, and transmits the adjusted set of measurement data to the pneumatic actuators coupled to the nose bridge.

Intelligent actuated nose bridge

A method performed on an augmented reality (AR) wearable device includes providing an over-the-air (OTA) update to all processors of a three-processor system, each processor of the three processor system having a respective current plurality of partitions and a respective last plurality of partitions. A communication error is detected between two or more processors of the three processor system after the OTA update. Respective active partitions are set for at least one of three processors to the last respective partition. The three processors are rebooted.

Recovery in a multiple processor system

A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

Hardware encoder for stereo stitching

An augmented reality (AR) eyewear device has a lens system which includes an optical screening mechanism that enables switching the lens system between a conventional see-through state and an opaque state in which the lens system screens or functionally blocks out the wearer's view of the external environment. Such a screening mechanism allows for expanded use cases of the AR glasses compared to conventional devices, e.g.: as a sleep mask; to view displayed content like movies or sports events against a visually non-distracting background instead of against the external environment; and/or to enable VR functionality.

Opacity control of augmented reality devices

Systems, methods, and non-transitory computer-readable media for a personalized avatar experience during a system boot process.

Personalized avatar experience during a system boot process

Systems and methods herein describe transmitting metadata to an augmented reality device using inaudible frequencies by receiving a first stream of inaudible sound waves in real-time, generating a first binary representation of the first stream of inaudible sound waves, generating a first set of metadata based on the first binary representation, generating a first plurality of augmented reality content items based on the first set of metadata, causing display of the first plurality of augmented reality content items on a display device coupled to the head-wearable apparatus as the first stream of inaudible sound waves is being received.

Transmitting metadata via inaudible frequencies

Systems and methods herein describe pausing operation of an augmented reality device based on user facial movement by monitoring user eye movement of a user of a head-wearable apparatus, determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus, based on the determination, pausing operation of one or more sensors of the head-wearable apparatus.

Growing community of inventors

San Diego, CA, United States of America

Farid Zare Seisan