Snap Inc.

Yu Jiang Tham

Andrés Monroy-Hernández

Rajan Vaish

Jonathan M Rodriguez, Ii

Gerald Nilles

Sven Kratz

Nir Daube

Brian Anthony Smith

John James Robertson

Ava Robinson

Jason Heger

Praveen Babu Vadivelu

Lei Zhang

Russell Douglas Patton

Fannie Liu

Ana Maria Cardenas Gasca

Miran Alhaideri

Antoine Ménard

Stephen Pomes

Peter Brook

Youjean Cho

Nicholas Larson

Daekun Kim

Zhihao Hong

Ilteris Kaan Canberk

Xing Mei

Tianying Chen

Timothy Chong

Olivia Seow

Tamer El Calamawy

Simon Nielsen

Jonathan Rodriguez

Joanne Leong

Xingyu Liu

Hanseul Jun

Hemant Surale

Mitchell Bechtold

Alex Bamberger

Tsung-Yu Tsai

Chunjong Park

Ella Dagan Peled

Karen Stolzenberg

Matthew Loukas Hanover

David Meisenholder

Shin Hwun Kang

Michael Xu

Savanah Frisk

Quan Thoi Minh Nguyen

Andrés Monroy-HERNÁNDEZ

Jonathan M Ii Rodriguez

A method and a system include receiving a first signal value generated by a biosignal sensor coupled to the first client device, receiving one or more second signal values corresponding to a respective sensor reading or environmental condition associated with the first client device, determining a total score based on a first score and one or more second scores determined based on the first and the one or more second signal values, selecting a first state of the plurality of states based on a ranking of total scores of the plurality of states, and causing a display of a first notification associated with a first user-selectable element corresponding to the first state on the first client device.

Non-textual communication and user states management

The users' experience of engaging with augmented reality (AR) technology that permits users to interact with their environment and with each other is enhanced by automatically selecting an AR experience that is suitable for use given the physical environment of the user. The physical environment of the user is the physical environment of the user's computing device. The physical environment may include objects and/or conditions present in close proximity to the user's computing device, such as other humans, animals, and smart devices.

Context-based selection of augmented reality experiences

A system and method for viewing a virtual digital object created from components having cryptocurrency value includes receiving a selection of at least one of an avatar, a captured image of the user or a third party, or a digital scene and receiving a selection of the virtual digital object for display on the selected avatar or captured image or within the digital scene. The virtual digital object includes metadata relating to at least one of cryptocurrency value of the virtual digital object, creation of the virtual digital object, and rules governing use and ownership of the virtual digital object. The user may manipulate the displayed virtual digital object within the display and may elect to display at least part of the metadata (e.g., price) along with the virtual digital object. The display of the virtual digital object may be captured and forwarded via a messaging or social media application.

Method, system, and computer readable medium for displaying virtual digital objects generated using blockchain technology

Systems and methods are described for sending a snapshot message using an electronic eyewear device by a first user capturing an image, identifying a physical marker in the captured image, and determining that the physical marker in the captured image has been within a field of view of the electronic eyewear device for a predetermined amount of time. A 3D snapshot including an object is captured and, each time the identified object appears in a field of view of the electronic eyewear device, a representation of the object is sent for display to a second user as if the real object was sent. The representation of the object may include the snapshot image, the object extracted from the snapshot image, a stored representation of the object, augmented reality content representing the object, etc.

Snapshot messages for indicating user state

Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.

Selectively activating a handheld device to control a user interface displayed by a wearable device

Augmented reality (AR) systems, devices, media, and methods are described for capturing and presenting effort put into generating a handcrafted AR experience. AR object generation data is captured during the generation of a handcrafted AR object. The AR object generation data is then processed to generate proof of effort data for inclusion with the handcrafted AR object. Examples of proof of effort include a time lapse view of the steps taken during generation of the AR object and statistics such as total time spent, number of images or songs considered for selection, number of actions implemented, etc.

Handcrafted augmented reality effort evidence

Systems and methods herein describe generating automatic reactions in an augmented reality messenger system. The claimed systems and methods generate a contextual trigger defining a set of conditions at a first computing device, detect at least one of the set of conditions has been satisfied, cause presentation of an augmented reality content item at a second computing device, generate a user reaction in response to the presentation of the augmented reality content item and transmit the user reaction to a first computing device.

Augmented reality auto reactions

Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.

Augmented reality prop interactions

A method for detecting full-body gestures by a mobile device includes a host mobile device detecting the tracked body of a co-located participant in a multi-party session. When the participant's tracked body provides a full-body gesture, the host's mobile device recognizes that there is a tracked body providing a full-body gesture. The host mobile device iterates through the list of participants in the multi-party session and finds the closest participant mobile device with respect to the screen-space position of the head of the gesturing participant. The host mobile device then obtains the user ID of the closest participant mobile device and broadcasts the recognized full-body gesture event to all co-located participants in the multi-party session, along with the obtained user ID. Each participant's mobile device may then handle the gesture event as appropriate for the multi-party session. For example, a character or costume may be assigned to a gesturing participant.

Co-located full-body gestures

Context-sensitive remote controls for use with electronic devices (e.g., eyewear device). The electronic device is configured to perform activities (e.g., email, painting, navigation, gaming). The context-sensitive remote control includes a display having a display area, a display driver coupled to the display, and a transceiver. The remote control additionally includes memory that stores controller layout configurations for display in the display area of the display by the display driver. A processor in the context-sensitive remote control is configured to establish, via the transceiver, communication with an electronic device, detect an activity currently being performed by the electronic device, select one of the controller layout configurations responsive to the detected activity, and present, via the display driver, the selected controller layout configuration in the display area of the display.

Context-sensitive remote eyewear controller

Eyewear having a light array and vibration sensors for indicating to a user when to turn left and right, such as when the eyewear is operating a navigation map application, that improves the user experience of eyewear devices for users having partial blindness or complete blindness. To compensate for partial blindness, the front portion of the eyewear frame, such as the bridge, may include the light array, where the left portion of the light array is illuminated to indicate to the user to turn left. The right portion of the light array is illuminated to indicate to the user to turn right. To compensate for complete users having complete blindness, the eyewear has a vibration device on each side of the eyewear, such as in the temples, which selectively vibrate to indicate when the user should turn left and right.

Navigation assistance for the visually impaired

Augmented reality (AR) systems, devices, media, and methods are described for creating a handcrafted AR experience. The handcrafted AR experiences are created by capturing images of a scene, identifying an object receiving surface and corresponding surface coordinates, identifying a customizable AR primary object associated with at least one set of primary object coordinates, generating AR overlays including the customizable AR primary object for positioning adjacent the object receiving surface, presenting the AR overlays, receiving customization commands, generating handcrafted AR overlays including customizations associated with the customizable AR primary object responsive to the customization commands, presenting the handcrafted AR overlays, recording the handcrafted AR overlays, creating a handcrafted AR file including the recorded overlays, and transmitting the handcrafted AR file.

Handcrafted augmented reality experiences

Methods and devices for wired charging and communication with a wearable device are described. In one embodiment, a symmetrical contact interface comprises a first contact pad and a second contact pad, and particular wired circuitry is coupled to the first and second contact pads to enable charging as well as receive and transmit communications via the contact pads as part of various device states.

Circuits and methods for wearable device charging and wired control

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate context based augmented reality communication between multiple users over a network. Virtual content item configuration data indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device is received from a first device. The virtual content item configuration data also includes one or more criteria to trigger application of the virtual content item to the real-world environment. A triggering event is detected based on satisfaction of the one or more criteria determined from context data generated at the second device. The second device presents the virtual content item overlaid on the real-world environment that is visible to the second user based on the triggering event.

Context based augmented reality communication

Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Smart ring for manipulating virtual objects displayed by a wearable device

Growing community of inventors

Los Angeles, CA, United States of America

Yu Jiang Tham