Snap Inc.

Daqri, LLC

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Osterreichisches Forschungsinstitut Fur Artificial Intelligence Der Osterreichischen Studiengesellschaft Fur Kybernetik of Freyung

Österreichisches Forschungsinstitut Für Artificial Intelligence Der Österreichischen Studiengesellschaft Für Kybernetik

Dominik Schnitzer

Daniel Wagner

Alex Feinman

Clemens Birklbauer

Alexander Kane

Heinrich Fink

Jeffrey Michael DeWall

Igor Komir

Kai Zhou

Amit Singh

Brian Mullins

Dunxu Hu

Mathieu Emmanuel Vignau

Bernhard Jung

Farid Zare Seisan

Lucas Kazansky

Roy Lawrence Ashok Inigo

Frank Chester Irving, Jr

Kiyoung Kim

Ulf Oscar Michel Loenngren

Jonathan Trevor Freeman

Erick Mendez

Mihajlo Marinkovic

A content creation system for extended Reality (XR) systems. The content creation system receives motion data of an XR device and generates trajectory data of a trajectory within a 3D environment model of a real-world scene based on the motion data where the trajectory simulates the motion of the XR device within the real-world scene. The content creation system receives user interaction event data and generates simulated sensor data based on the trajectory data, the 3D environment model, and the user interaction event data. The content creation system generates simulated tracking data based on the simulated sensor data and determines simulated power consumption data and thermal condition data based on operation of the computer vision component while generating the simulated tracking data. The content creation system generates a display from a user's perspective of the 3D environment model along with the simulated power consumption and thermal data.

Content creation platform for XR devices

A method performed on an augmented reality (AR) wearable device includes providing an over-the-air (OTA) update to all processors of a three-processor system, each processor of the three processor system having a respective current plurality of partitions and a respective last plurality of partitions. A communication error is detected between two or more processors of the three processor system after the OTA update. Respective active partitions are set for at least one of three processors to the last respective partition. The three processors are rebooted.

Recovery in a multiple processor system

Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.

Rolling shutter camera pipeline exposure timestamp error determination

A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.

System for using digital light projectors for augmented reality

Disclosed are systems, methods, and non-transitory computer-readable media for reducing latency in augmented reality displays. A display controller receives, from a GPU, a stream of image pixels of a frame of virtual content to be presented on a display of a display device. The stream of image pixels is received via a high-speed bulk interface that transfers data at least as fast as can be consumed by the display. As the stream of image pixel is received, the display controller converts each respective image pixel from a data format used to transmit the stream of image pixels via the high-speed bulk interface to a data format that is compatible for display by the display. Each converted image pixel is stored in a pixel cell of the display, after which the frame is presented on the display.

Reducing latency in augmented reality (AR) displays

Disclosed are systems and methods for adaptively adjusting brightness of a wearable device projection system. The systems and methods perform operations comprising: causing projection elements of the AR wearable device to project an image; receiving a measure of ambient light from an ambient light sensor; adjusting one or more hardware parameters of the projection elements of the AR wearable device based on the measure of ambient light; modifying one or more color values of the image displayed by the projection elements of the AR wearable device based on the measure of ambient light; and projecting the image with the modified color values using the projection elements of the AR wearable device with the adjusted one or more hardware parameters.

Adaptive brightness for augmented reality display

An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Environmental mapping system

In order to be able to handle very large numbers of tracks in a similarity determination in order to identify tracks similar to a predetermined track, a filtering method is used in order to identify a number of closest neighbor candidates between which the correct nearest neighbors are determined. Thus, the computationally heavy similarity determination is performed only on a subset of the tracks. This filtering step may be a fastmap determination of the tracks where the pivot points are determined not as the extreme points along the to individual dimension but at the median thereof in order to avoid extremely high divergence values. This helps preserving the neighborhoods. Also, the mapping is performed on the basis of a square-rooted Symmetric Kullback-Leibler (SKL) divergence which is more metric than the SKL and thus provides a better mapping.

Method and a system for identifying similar audio tracks

Growing community of inventors

Vienna, Austria

Dominik Schnitzer