Snap Inc.

Bo Ding

Dmitry Ryuma

Matthias Kalkgruber

Daniel Wolf

John James Robertson

Ozi Egri

Alexander Kane

Chintan Doshi

Gerald Nilles

Scott Lerner

Anton Kondratenko

A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

Dynamic adjustment of exposure and ISO to limit motion blur

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

Ultra low power camera pipeline for CV in AR systems

Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.

Multi-purpose cameras for simultaneous capture and CV on wearable AR devices

Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.

Image device auto exposure

Dynamic adjustment of exposure and iso to limit motion blur

The present application discloses various systems, methods and non-transitory computer-readable mediums that include a first device and a second device to perform processing on a digital image. According to one example, a second one or more edits made using the second device are user subjective and a first one or more edits made using the first device are user agnostic. The second one or more edits are reliant on the first one or more edits for processing flexibility to achieve a desired image attribute.

Systems and methods for multi-device image processing

An auto exposure method for an image capture device includes the steps of gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate corresponding to the gathered ambient light data, and determining an optimal image capture frame rate for the image capture device. The auto exposure method determines the optimal image capture frame rate by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm.

Growing community of inventors

Boulder, CO, United States of America

Bo Ding