Snap Inc.

Daqri, LLC

Erick Mendez

Daniel Wagner

Kai Zhou

Brian Mullins

Matthias Kalkgruber

Daniel Wolf

Bernhard Jung

Dominik Schnitzer

Clemens Birklbauer

Lucas Kazansky

Frank Chester Irving, Jr

Roy Lawrence Ashok Inigo

Kiyoung Kim

Jonathan Trevor Freeman

Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.

Visual-inertial tracking using rolling shutter cameras

An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Environmental mapping system

Growing community of inventors

Vienna, Austria

Erick Mendez