Sony Corporation

Sony Group Corporation

Junji Shimada

Hiroshi Yamamoto

Makoto Ohta

Hitoshi Ueda

Takashi Kawai

Akihisa Tanaka

An imaging device is configured to perform processing of generating, as metadata associated with a captured image, correction information based on both a first blur correction value related to a first blur correction function of correcting a positional relationship between an optical image incident through a lens and an output captured image and a second blur correction value related to a second blur correction function provided in a lens barrel including the lens.

Imaging device and imaging method

An electronic device to autofocus on an object-of-interest within a field-of-view of the electronic device, includes an image sensor and a circuitry. The image sensor captures a sequence of image frames that includes a current frame and detect at least one prominent region in the current frame. The detected at least one prominent region has an optical flow similar to a direction of motion of the electronic device. The circuitry selects a region-of-interest from the detected at least one prominent region and estimates an autofocus point in the detected at least one prominent region. The circuitry controls focus of the image sensor at the estimated autofocus point in the current frame. The focus of the image sensor is controlled such that the estimated autofocus point exhibits a minimum deviation from an initialized position for the estimated autofocus point within the detected at least one prominent region.

Electronic device to autofocus on objects of interest within field-of-view of electronic device

An electronic device comprises an image sensor that captures a sequence of image frames of a scene. The electronic device includes circuitry that generates an optical flow map for a current frame of the sequence of image frames received from the image sensor. The circuitry determines a plurality of likelihood-of-prominence values for the plurality of regions, based on the generated optical flow map and a motion vector that maps to a direction of motion of the electronic device. The circuitry is configured to detect at least a first region that has a direction of motion similar to that of the electronic device, as a region-of-prominence, based on the determined plurality of likelihood-of-prominence values for the plurality of regions. The circuitry is configured to track the desired object in the sequence of image frames based on the detection of the first region of the current frame as the region-of-prominence.

Prominent region detection in scenes from sequence of image frames

An apparatus and method for improving camera depth estimations for a moving subject in the camera field of view. The camera utilizes a generative adversarial network (GAN) to predict future frames from a current frame(s). These predicted future frames are then utilized as a target for determining a depth map from which lens focusing direction and distance are determined for moving the camera into proper focus and thus reducing focusing errors on captured frames as target and/or camera motion progresses.

Camera depth prediction using generative adversarial network

Various aspects of a system and a method are provided for detection of objects in motion are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which is configured to compute a first sensor offset for a current frame based on a first motion vector and a second motion vector. A validation of the first motion vector is determined based on the second motion vector and one or more criteria. An object in motion from the current frame is extracted based on the first sensor offset of the current frame and the determined validation of the first motion vector.

Image processing system and method for detection of objects in motion

Various aspects of a system and a method are provided for detection of objects in motion are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which computes a first motion vector based on a difference of pixel values of one or more pixels in a current frame with respect to a previous frame. The current frame and the previous frame comprises at least an object in motion. The system further computes a second motion vector by use of motion-based information obtained from a sensor in the electronic device. The system determines validation of the first motion vector based on the second motion vector and one or more criteria and extracts the object in motion from the current frame based on the determined validation of the first motion vector.

A panoramic image is to be easily generated. A driverdisplaces at least one of a lens unitand an image capturing elementwith respect to an optical axis. A control unitdisplaces, using the driver, at least one of the lens unitand the image capturing elementin accordance with a motion of an image capturing apparatus. When generating a plurality of captured images while shifting an image capturing direction in order to generate a panoramic image from the plurality of captured images, the control unitchanges a position of the lens unitand/or the image capturing element, the position being a position at the start of exposure of each of the captured images, in a direction set according to a direction in which the image capturing direction shifts, thereby performing correction of deviation caused by a motion of the image capturing apparatus.

Image capturing apparatus and image capturing method

An image capturing apparatus includes: a system selector configured to select either one of a focus control of a contrast system in which a wobbling motion is performed for detection and a focus control of a different system that is different from the focus control of the contrast system; and a controller configured to set a first wobbling amount for the focus control of the different system to be smaller than a second wobbling amount for the focus control of the contrast system.

Auto focus control of image capturing apparatus

An image capturing apparatus includes a driving unit for displacing one of a lens unit and an imaging device with respect to an optical axis, and a controller for causing the driving unit to displace one of the lens unit and the imaging device, in response to the motion of the image capturing apparatus. When, with a shooting direction being moved, captured images are generated so that a panoramic image is generated from the captured images, the controller displaces the position of the lens unit or the imaging device at the start of exposure of each image to be captured in a direction based on a direction in which the shooting direction is moved. In addition, a displacement amount at the start of the exposure is set in response to the length of an exposure time period so that the displacement during the exposure time period becomes small and the quality of an image is improved.

An imaging device includes an image capturing element which photoelectrically converts a subject image into electrical charge information, a driving device which drives a driving part related to image capturing, and a controlling unit which changes a driving frequency of the driving device at a timing to read the electrical charge information from the image capturing element.

Device and method for image processing

An image pickup apparatus to pick up images by using a solid-state image pickup device includes an image signal reading unit configured to read image signals of a rectangular effective area in an image picked up by the solid-state image pickup device; an effective area setting unit configured to set the effective area to the image signal reading unit so that pixel signals of all pixels of the solid-state image pickup device in one of vertical and horizontal directions of the effective area are read and that a redundant pixel area is provided in the other direction; a camera shake detecting unit configured to detect camera shake in the image pickup apparatus; and a camera shake correction control unit configured to shift the effective area to the other direction so as to correct the camera shake in the other direction detected by the camera shake detecting unit.

Growing community of inventors

Tokyo, Japan

Junji Shimada