Samsung Electronics Co., Ltd.

Other

Long N Le

Hamid Rahim Sheikh

John W Glotzbach

Ruiwen Zhen

Zhen Tong

Sourabh Ravindran

Ibrahim Pekkucuksen

Yibo Xu

Deboleena Roy

Michael Oliver Polley

Andrew Namminga

Zeeshan Nadir

Injoon Hong

Alex Thanh Nguyen

Vitali Loseu

Rian Abraham

Jake Steelman

A method includes obtaining a blended red-green-blue (RGB) image frame of a scene. The method also includes performing, using at least one processing device of an electronic device, an interband denoising operation to remove at least one of noise and one or more artifacts from the blended RGB image frame in order to produce a denoised RGB image frame. Performing the interband denoising operation includes performing filtering of red, green, and blue color channels of the blended RGB image frame to remove at least one of the noise and the one or more artifacts from the blended RGB image frame. The filtering of the red and blue color channels of the blended RGB image frame is based on image data of at least one of the green color channel and a white color channel of the blended RGB image frame.

Apparatus and method for interband denoising and sharpening of images

A method includes obtaining multiple input image frames and determining how to warp at least one of the input image frames. The method also includes performing an intraband demosaic-warp operation to reconstruct image data in different color channels of the input image frames and warp the at least one input image frame to produce RGB input image frames. The method further includes blending the RGB input image frames to produce a blended RGB image frame, performing an interband denoising operation to produce a denoised RGB image frame, and performing an interband sharpening operation to produce a sharpened RGB image frame. In addition, the method includes performing an interband demosaic operation to substantially equalize high-frequency content in different color channels of the sharpened RGB image frame to produce an equalized sharpened RGB image frame and generating a final image of the scene based on the equalized sharpened RGB image frame.

Apparatus and method for combined intraband and interband multi-frame demosaicing

A method includes capturing a plurality of first images using a first image sensor and capturing a plurality of second images using a second image sensor. The method also includes estimating depth information based on at least one of the first images and at least one of the second images. The method further includes obtaining information related to a lighting direction from an artificial intelligence (AI) light director, where the AI light director is trained to determine one or more lighting directions. In addition, the method includes generating at least one relit image using at least one of the first and second images based on the obtained information related to the lighting direction and the estimated depth information.

Multi-frame depth-based multi-camera relighting of images

A method includes obtaining multiple images of a scene using at least one red-green-blue-white (RGBW) image sensor. The method also includes generating multi-channel frames at different exposure levels from the images. The method further includes estimating motion across exposure differences between the different exposure levels using a white channel of the multi-channel frames as a guidance signal to generate multiple motion maps. The method also includes estimating saturation across the exposure differences between the different exposure levels to generate multiple saturation maps. The method further includes using the generated motion maps and saturation maps to recover saturations from the different exposure levels and generate a saturation-free RGBW frame. In addition, the method includes processing the saturation-free RGBW frame to generate a final image of the scene.

System and method for multi-exposure, multi-frame blending of red-green-blue-white (RGBW) images

A method includes obtaining, using at least one processor of an electronic device, a high dynamic range (HDR) input Bayer image. The method also includes generating, using the at least one processor of the electronic device, a plurality of synthesized images at different exposure levels based on the input Bayer image. The method further includes fusing, using the at least one processor of the electronic device, the synthesized images to generate a fused image. The method also includes generating, using the at least one processor of the electronic device, a gain map based on the fused image. In addition, the method includes applying, using the at least one processor of the electronic device, a gain based on the gain map to the input Bayer image.

Systems and methods for dynamic range compression in multi-frame processing

A method includes capturing a plurality of first images using a first image sensor and a plurality of second images using a second image sensor. The method also includes generating a short single view, short depth map, long single view, and long depth map from the first and second images. The method further includes generating a multi-frame depth map using the short single view, short depth map, long single view, and long depth map. The method also includes generating a gain map using the multi-frame depth map and lighting conditions, where the lighting conditions introduce a relighting effect into the gain map. The method further includes generating a relit short single view and a relit long single view by applying the gain map to the short and long single views. In addition, the method includes generating a relit image by fusing the relit short and long single views.

A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.

Apparatus and method for high dynamic range (HDR) image creation of dynamic scenes using graph cut-based labeling

A method of compensating for a movement of a device worn by a user is described. The method comprises measuring, using a first sensor, a motion of a user wearing the device; measuring, using a second sensor, a motion of the device; determining a difference in the motion of the device with respect to the motion of the user; and compensating for the difference in the motion of the device with respect to the motion of the user. An electronic device for monitoring a device worn by a user is also disclosed.

Compensating for a movement of a sensor attached to a body of a user

An electronic device, method, and computer readable medium for accurate, low latency pose fusion architecture for SLAM are provided. The electronic device includes an IMU sensor, a camera, a display, and a processor coupled to the IMU sensor, the camera, and the display. The processor determines a vision pose in a camera coordinate based on the captured vision data; transforms the vision pose from the camera coordinate to an IMU coordinate; applies a scale factor, based on a combination of the vision pose and an IMU pose in the IMU coordinate, to the vision pose; fuses the scaled vision pose and the IMU pose into a fused pose in a temporally distributed manner; and outputs the fused pose for use with the display.

System and method for low latency, high performance pose fusion

A method includes obtaining, using at least one image sensor of an electronic device, a first image frame of a scene. The method also includes using a convolutional neural network to generate, from the first image frame, multiple second image frames simulated to have different exposures. One or more objects in the scene in each second image frame are aligned with one or more corresponding objects in the scene in at least one other second image frame and are aligned with one or more corresponding objects in the scene in the first image frame. The method further includes blending the multiple second image frames to generate a final image of the scene.

System and method for generating multi-exposure frames from single input

A method includes obtaining, using at least one image sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a plurality of short image frames at a first exposure level and a plurality of long image frames at a second exposure level longer than the first exposure level. The method also includes generating a short reference image frame and a long reference image frame using the multiple image frames. The method further includes selecting, using a processor of the electronic device, the short reference image frame or the long reference image frame as a reference frame, where the selection is based on an amount of saturated motion in the long image frame and an amount of a shadow region in the short image frame. In addition, the method includes generating a final image of the scene using the reference frame.

System and method for dynamic selection of reference image frame

A method includes capturing multiple ambient images of a scene using at least one camera of an electronic device and without using a flash of the electronic device. The method also includes capturing multiple flash images of the scene using the at least one camera of the electronic device and during firing of a pilot flash sequence using the flash. The method further includes analyzing multiple pairs of images to estimate exposure differences obtained using the flash, where each pair of images includes one of the ambient images and one of the flash images that are both captured using a common camera exposure and where different pairs of images are captured using different camera exposures. In addition, the method includes determining a flash strength for the scene based on the estimate of the exposure differences and firing the flash based on the determined flash strength.

Apparatus and method for capturing and blending multiple images for high-quality flash photography using mobile electronic device

A method includes capturing multiple pairs of images of a scene at different exposures using at least one camera of an electronic device. Each pair of images includes (i) an ambient image of the scene captured without using a flash of the electronic device and (ii) a flash image of the scene captured using the flash of the electronic device. The method also includes rendering a final image of the scene with a bokeh that is determined using the multiple pairs of images. One of the ambient images or the flash images are captured in order of increasing exposure time, and the other of the ambient images or the flash images are captured in order of decreasing exposure time. The method may also include estimating a depth map associated with the scene using the pairs of images, where the bokeh is based on the depth map.

Apparatus and method for generating low-light images with improved bokeh using mobile electronic device

A case for a mobile device includes a bumper portion and a module portion. The module portion is attached to the bumper portion. The bumper portion has a border configured to receive a mobile device. The module portion includes a base portion, a back plate and battery portion. The base portion is attached to the back plate. The battery portion is positioned between the base portion and the back plate. The battery portion includes a plurality of battery cells, a printed circuit board assembly and a plurality of electromagnetic induction coils all operably connected to one another.

Growing community of inventors

Richardson, TX, United States of America

Long N Le