Apple Inc.

Stephane S Ben Soussan

Jianping Zhou

Sebastien X Beysserie

Florian Ciurea

Michael Wish Tao

Geoffrey T Anneheim

Ahmed Tashrif Kamal

Feng Li

Saeed Izadi

Bruno J Conejo

Devices, methods, and non-transitory computer readable media are disclosed herein to repair or mitigate the appearance of unwanted reflection artifacts in captured video image streams. These unwanted reflection artifacts often present themselves as brightly-colored spots, circles, rings, or halos that reflect the shape of a bright light source in the captured image. These artifacts, also referred to herein as 'ghosts' or “green ghosts” (due to often having a greenish tint), are typically located in regions of the captured images where there is not actually a bright light source located in the image. In fact, such unwanted reflection artifacts often present themselves on the image sensor across the principal point of the lens from where the actual bright light source in the captured image is located. Such devices, methods and computer readable media may be configured to detect, track, and repair such unwanted reflection artifacts in an intelligent and efficient fashion.

Efficient unwanted reflection artifact mitigation in videos for embedded devices

Determining disparity includes obtaining a first image of a scene and a second image of a scene, determining correspondences between one or more pixels of the first image and one or more pixels of the second image, performing local denoising on the correspondences based on at least on a strength and direction of gradient values for the one or more pixels of the first image and the one or more pixels of the second image, and generating a disparity map based on the determined correspondences and local denoising.

Robust hardware efficient disparity estimation using total-variation L1 regularization

Techniques to improve a digital image capture device's ability to stabilize a video stream&#x2014;while enforcing desired stabilization constraints on particular images in the video stream&#x2014;are presented that utilize an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a 'current' frame can use motion data from both 'past' and &#x201c;future&#x201d; frames to adjust the value of a stabilization strength parameter and/or the weighted contribution of particular frames from the buffer in the determination of stabilization motion values for the current frame. Such techniques keep the current frame within its overscan and ensure that the stabilization constraints are enforced, while maintaining desired smoothness in the video stream. In some embodiments, the stabilization constraint may comprise a maximum allowed frame displacement.

Video image stabilization with enforced stabilization constraints

Growing community of inventors

San Francisco, CA, United States of America

Stephane S Ben Soussan