Canon Kabushiki Kaisha

Keigo Yoneda

Michio Aizawa

An image processing apparatus obtains one or plurality of images based on capturing by one or plurality of image capturing apparatuses, obtains information related to a virtual object, and generates a two-dimensional image including the virtual object, based on the one or plurality of obtained images and the obtained information related to the virtual object. The image processing apparatus generates the two-dimensional image by determining color information of the virtual object based on color information of a real object included in the one or plurality of images.

Image processing apparatus, method for controlling image processing apparatus, and storage medium

A virtual viewpoint foreground image generating unit generates a virtual viewpoint foreground image, which is an image of a foreground object seen from a virtual viewpoint without a shadow, based on received multi-viewpoint images and a received virtual viewpoint parameter. A virtual viewpoint background image generating unit generates a virtual viewpoint background image, which is an image of a background object seen from the virtual viewpoint, based on the received multi-viewpoint images and virtual viewpoint parameter. A shadow mask image generating unit generates shadow mask images from the received multi-viewpoint images. A shadow-added virtual viewpoint background image generating unit renders a shadow in the virtual viewpoint background image based on the received virtual viewpoint background image, shadow mask images, and virtual viewpoint parameter. A combined image generating unit generates a virtual viewpoint image by combining the virtual viewpoint foreground image with the shadow-added virtual viewpoint background image.

Image processing apparatus, image processing method, and storage medium

An image processing apparatus obtains virtual viewpoint information indicating at least a position of a virtual viewpoint and a view direction from the virtual viewpoint and generates a virtual viewpoint image based on the virtual viewpoint information and a plurality of images captured from a plurality of viewpoints by hiding processing a specific region of the virtual viewpoint image, the specific region being determined based on that the obtained virtual viewpoint information satisfies a condition.

A control is performed such that a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to a specific user operation during playback of the virtual viewpoint image at a first playback speed becomes lower than a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to the specific user operation during playback of the virtual viewpoint image at a second playback speed higher than the first playback speed.

Information processing apparatus, information processing method, and storage medium

An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.

Information processing apparatus, information processing method, and computer readable storage medium for determining a moving path of virtual viewpoint

An image processing apparatus that generates a virtual viewpoint image based on images obtained by a plurality of cameras that capture an image capturing area from a plurality of directions and on viewpoint information indicating a position and direction of a virtual viewpoint, the image processing apparatus including: a determining unit configured to determine a priority of an object in the image capturing area; a control unit configured to control a display manner of the object in the virtual viewpoint image, based on the priority of the object determined by the determining unit, so that processing time related to generation of the virtual viewpoint image does not exceed a predetermined amount of time; and a generating unit configured to generate the virtual viewpoint image according to control by the control unit.

Growing community of inventors

Kanagawa, Japan

Keigo Yoneda