Snap Inc.

Other

Jonathan M Rodriguez, Ii

Russell Douglas Patton

Yu Jiang Tham

Peter Brook

Matthew Loukas Hanover

Nir Daube

Alex Bamberger

Nicolas Dahlquist

Linjie Luo

Jia Li

Rahul Bhupendra Sheth

Xutao Lv

Nathan Jurgenson

Gerald Nilles

Samuel Bryson Thompson

Ilteris Kaan Canberk

Kenneth Kubala

Julio Cesar Castañeda

Benjamin Lucas

Edmund Graves Brown

Richard Zhuang

David Meisenholder

Stephen Andrew Steger

Kimberly A Phifer

Evan Spiegel

Ugur Olgun

Patrick Timothy McSweeney Simons

Amit Singh

David G Fliszar

Robert Matthew Bates

Michael Ryner

Patrick J Kusbel

Adam Douglas Greengard

Brandon Carrillo

Yuncheng Li

Zehao Xue

Stephen Pomes

Yingying Wang

James Powderly

Ashley Macon

Simon Nielsen

Jennica Pounds

Jonathan Geddes

Andrei Rybin

Ryan Pruden

A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.

AR odometry sensor fusion using personal vehicle sensor data

Methods and devices for wired charging and communication with a wearable device are described. In one embodiment, a symmetrical contact interface comprises a first contact pad and a second contact pad, and particular wired circuitry is coupled to the first and second contact pad to enable charging as well as receive and transmit communications via the contact pads as part of various device states.

Circuits and methods for wearable device charging and wired control

Eyewear including a frame, a projector supported by the frame, and a lens supported by the frame. The lens has a first surface facing an eye of the user and a second surface facing away from the eye of the user when the frame is worn. The lens also includes a waveguide defined by the first and second surfaces to receive light from the projector. An input light coupler and an output light coupler are on the first surface of the lens and at least one reflector is positioned on a second surface of the lens to redirect light received from the input coupler and/or the output coupler to redirect light having an angle of incidence with respect to the second surface of the lens that would result in that portion of the light exiting the waveguide through the second surface in the absence of the at least one reflector.

Eyewear waveguide with reflector

System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

Systems and methods for DSP fast boot

Systems, devices, media, and methods are presented for using a flexible electronic device to selectively interact with an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. A flexible electronic device includes an integrated circuit, a plurality of input sensors, and a power system, all mounted on a flexible substrate that is sized and shaped to conform to a graspable object such as a ring. The flexible electronic device operates according to a power budget, operating on a sensor power budget until it detects a first interaction with at least one of the input sensors. If the first interaction exceeds a sensitivity threshold, the flexible electronic device sends a wake signal to a nearby eyewear device. In response to the wake signal, the eyewear device presents a graphical user interface (GUI) on the display. The eyewear device further presents a cursor along a path on the display that is substantially correlated to the course traveled by the flexible electronic device in motion along a course.

Ring-mounted flexible circuit remote control

Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.

Selectively activating a handheld device to control a user interface displayed by a wearable device

Eyewear providing an interactive augmented reality experience to users in a first physical environment viewing objects in a second physical environment (e.g., X-ray effect). The second environment may be a room positioned behind a barrier, such as a wall. The user views the second environment via a sensor system moveable on the wall using a track system. As the user in the first environment moves the eyewear to face the outside surface of the wall along a line-of-sight (LOS) at a location (x, y, z), the sensor system on the track system repositions to the same location (x, y, z) on the inside surface of wall. The image captured by the sensor system in the second environment is wirelessly transmitted to the eyewear for displayed on the eyewear displays, providing the user with an X-ray effect of looking through the wall to see the objects within the other environment.

Augmented reality eyewear with x-ray effect

Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Smart ring for manipulating virtual objects displayed by a wearable device

Augmented reality eyewear devices allow users to experience a version of our 'real' physical world augmented with virtual objects. Augmented reality eyewear may present a user with a graphical user interface that appears to be in the airspace directly in front of the user thereby encouraging the user to interact with virtual objects in socially undesirable ways, such as by making sweeping hand gestures in the airspace in front of the user. Anchoring various input mechanisms or the graphical user interface of an augmented reality eyewear application to a wristwatch may allow a user to interact with an augmented reality eyewear device in a more socially acceptable manner. Combining the displays of a smartwatch and an augmented reality eyewear device into a single graphical user interface may provide enhanced display function and more responsive gestural input.

Wristwatch based interface for augmented reality eyewear

Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Systems and methods for wearable initiated handshaking

Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.

Situational-risk-based AR display

Methods and systems are disclosed for performing operations for displaying virtual content on a contact lens. The operations comprise causing the contact lens to operate in a first display mode to allow unobstructed light associated with a real-world environment to be received by a pupil of a user; detecting a condition associated with display of virtual content; selecting between a second display mode and a third display mode as a new display mode in which to operate the contact lens, the second display mode obstructing a portion of the light associated with a real-world environment received by the pupil with the virtual content, the third display mode obstructing all of the light associated with a real-world environment received by the pupil with the virtual content; and transitioning the contact lens from operating in the first display mode to operating in the new display mode in response to detecting the condition.

AR/VR enabled contact lens

One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Reducing boot time and power consumption in displaying data content

Displays and eyewear devices incorporating displays are disclosed. One display includes a light source, a first display region, and a second display region. The first display region includes a first contiguous array of pixels. The first contiguous array of pixels includes a first group of pixels and a second group of pixels interspersed with the first group of pixels. The first group of pixels is adapted to emit light from the light source in only a first wavelength band and the second group of pixels is adapted to emit light from the light source in only a second wavelength band different from the first wavelength band. The second display region consists essentially of a second contiguous array of pixels. The second contiguous array of pixels is adapted to emit light from the light source in a predetermined wavelength band.

Display devices, methods and eyewear incorporating displays having different groups of pixels emitting light at different wavelengths

An eyewear device that performs diarization by segmenting spoken language into different speakers and remembering each speaker over the course of a session. The speech of each speaker is translated to text and the text of each speaker is displayed on an eyewear display. The text of each user has a different attribute such that the eyewear user can distinguish the text of different speakers. Examples of the text attribute can be a text color, font, and font size. The text is displayed on the eyewear display such that it does not substantially obstruct the user's vision.

Eyewear including diarization

Growing community of inventors

Los Angeles, CA, United States of America

Jonathan M Rodriguez, Ii