Snap Inc.

Dunxu Hu

Patrick Timothy McSweeney Simons

Russell Douglas Patton

Peter Brook

Ashwani Arya

Zhibin Zhang

Tejas Arun Bahulkar

Dmitry Ryuma

Alex Feinman

David Ben Ezra

Michael Asfaw

Victoria Lulu Wang Limketkai

Gerald Nilles

Jason Heger

Daniel C Wiggins

Praveen Babu Vadivelu

Daniel Harris

Ugur Olgun

Kai Zhou

Patrick Timothy Mcsweeney Simons

Dominik Schnitzer

Eric Nachtigall

Xinrong Wei

An XR system is provided that enhances user interaction within extended reality environments through precise hand scale estimation. The XR system is configured to capture tracking data of a user's hand as the user interacts with a mobile device. Concurrently, the XR system captures pose data of itself and uses the tracking data and the pose data to determine a reference line segment. This segment aids in calculating three-dimensional distances between node pairs of the user's hand. By employing these measurements, the XR system effectively calculates a hand scale factor that is used for accurately integrating the user's hands into an XR user interface.

Hand scale factor estimation from mobile interactions

A content creation system for extended Reality (XR) systems. The content creation system receives motion data of an XR device and generates trajectory data of a trajectory within a 3D environment model of a real-world scene based on the motion data where the trajectory simulates the motion of the XR device within the real-world scene. The content creation system receives user interaction event data and generates simulated sensor data based on the trajectory data, the 3D environment model, and the user interaction event data. The content creation system generates simulated tracking data based on the simulated sensor data and determines simulated power consumption data and thermal condition data based on operation of the computer vision component while generating the simulated tracking data. The content creation system generates a display from a user's perspective of the 3D environment model along with the simulated power consumption and thermal data.

Content creation platform for XR devices

Methods and systems are disclosed for detecting whether a wearable device is being worn by a user. The system transmits a radio signal from a first communication device of a wearable device to a second communication device of the wearable device and measures a signal strength associated with the radio signal received by the second communication device. The system compares the signal strength to a threshold value and generates an indication of a wear status associated with the wearable device based on comparing the signal strength to the threshold value.

Detecting wear status of wearable device

A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

Low-power architecture for augmented reality device

Systems and methods for determining a location of a wearable electronic device are disclosed. In some aspects, the device includes a position acquisition device and an accelerometer. A hardware processor included in the device may be configured to generally maintain the position acquisition device in a low power state to save power. When a video or image is captured, it may tag the video or image with first location information. Given the inoperative position acquisition device, a current location may not be known. In some aspects, in response to a need for location information, measurements from an accelerometer may be stored. The position acquisition device may also be transitioned to an operative state, and after some time delay, a second location determined. In some aspects, the location of the capture may then be obtained based on the acceleration measurements and the second location.

Wearable satellite receiver with reduced power consumption

Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Eyewear with a system on a chip with simultaneous USB communications

Head-wearable apparatus to generate binaural audio content includes a first stem coupled to a first microphone housing that encases first front microphone and first rear microphone that generates acoustic signals, respectively. First microphone housing includes a first front port that faces downward and a first rear port that faces backwards. Apparatus includes second stem coupled to second microphone housing that encases second front microphone and second rear microphone that generate acoustic signals, respectively. Second microphone housing includes second front port that faces downward and second rear port that faces backwards. Apparatus includes binaural audio processor that includes beamformer and storage device. Beamformer generate first beamformer signal based on acoustic signals from first front microphone and first rear microphone, and second beamformer based on acoustic signals from second front microphone and second rear microphone. Storage device stores first and second beamformer signals as a two-channel file.

Head-wearable apparatus to generate binaural audio

Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.

Head-related transfer function

Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

Growing community of inventors

Los Angeles, CA, United States of America

Dunxu Hu