Snap Inc.

Chintan Doshi

John James Robertson

Dmitry Ryuma

Bo Ding

Alexander Kane

Gerald Nilles

Matthias Kalkgruber

Fedir Poliakov

Omer Cansizoglu

Stanislav Minakov

Anton Kondratenko

Justin Wilder

Yuechuan Li

The subject technology sends captured image data and metadata to a first set of computing processes for processing. The subject technology receives, asynchronously from a second set of computing processes, second metadata. The subject technology detects a signal indicating a command to stop image data capturing. The subject technology, in response to the detected signal, generating a composite AR content item based on the metadata and the captured image data. The subject technology provides the composite AR content item for rendering for display on an eyewear device.

Recording augmented reality content on an eyewear device

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

Ultra low power camera pipeline for CV in AR systems

Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.

Multi-purpose cameras for simultaneous capture and CV on wearable AR devices

Growing community of inventors

Marina Del Rey, CA, United States of America

Chintan Doshi