Snap Inc.

James Powderly

Ilteris Kaan Canberk

Shin Hwun Kang

Michael David Marr

Jonathan M Rodriguez, Ii

Matthew Loukas Hanover

Sergei Korolev

Daniel Colascione

Dmytro Hovorov

Scott Myers

Ashley Macon

Karen Stolzenberg

David Meisenholder

Dhritiman Sagar

Sumant Milind Hanumante

Mathieu Emmanuel Vignau

Dmytro Kucher

Viktoria Hwang

Daria Skrypnyk

Justin Wilder

Display screen or portion thereof with a graphical user interface

Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and speakers. The eyewear device captures image information for an environment surrounding the device, identifies a match between objects in the image information and predetermined objects in previously obtained information for the same environment. The eyewear device then identifies a target location within the environment, which may be associated with a physical or a virtual object. The eyewear device monitors its orientation with respect to the target location and presents audio signals to guide the user toward the target location.

Immersive augmented reality experiences using spatial audio

A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.

Visual and audio wake commands

Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a 'spheroidal balancing' augmented reality experience and a “spheroidal balancing” augmented reality experience.

Interactive augmented reality experiences using positional tracking

Augmented reality experiences of a user wearing an electronic eyewear device are captured by at least one camera on a frame of the electronic eyewear device, the at least one camera having a field of view that is larger than a field of view of a display of the electronic eyewear device. An augmented reality feature or object is applied to the captured scene. A photo or video of the augmented reality scene is captured and a first portion of the captured photo or video is displayed in the display. The display is adjusted to display a second portion of the captured photo or video with the augmented reality features as the user moves the user's head to view the second portion of the captured photo or video. The captured photo or video may be transferred to another device for viewing the larger field of view augmented reality image.

Extended field-of-view capture of augmented reality experiences

Eyewear having a camera capturing images, and an image processor configured to process the images and display the processed image in both controlled and uncontrolled regions on the display. In an example, the image processor applies a vignette gradient to soften edges of the displayed image in the uncontrolled regions, which compensates for any discoloration in the uncontrolled regions. The uncontrolled regions may be located above and below the controlled region.

Eyewear display for generating an immersive image

Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a 'spheroidal balancing' augmented reality experience and a 'spheroidal balancing' augmented reality experience.

Growing community of inventors

Venice, CA, United States of America

James Powderly