Canon Kabushiki Kaisha

Shogo Mizuno

Atsushi Date

Kenichi Fujii

Akihiro Matsushita

Michio Aizawa

Tomohiro Yano

Masahiro Handa

Katsumasa Tanaka

Keisuke Morisawa

Mai Komiyama

An image processing apparatus predicts a virtual viewpoint in a second frame subsequent to a first frame in a virtual viewpoint image and a position of a three-dimensional subject model in the second frame. The image processing apparatus determines an image capturing apparatus from which a captured image to be used for generating the second frame is obtained from among the plurality of image capturing apparatuses based on the predicted virtual viewpoint, the predicted position of the three-dimensional subject model, and image capturing parameters of the image capturing apparatuses, and generates the virtual viewpoint image based on the captured image for the second frame obtained from the determined image capturing apparatus, the three-dimensional subject model corresponding to the second frame, and the virtual viewpoint information corresponding to the second frame.

Image processing apparatus, method, system, and storage medium to generate a virtual viewpoint image based on a captured image

A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.

Method for generating virtual viewpoint image and image processing apparatus

It is an object of the present invention to reduce a possibility that a subject (specific object) of a virtual viewpoint image and a virtual object area overlap. To achieve the object, the present invention comprises a first identifying unit for identifying a three-dimensional position of the specific object captured respectively from different directions by a plurality of cameras; a second identifying unit for identifying a three-dimensional position of a virtual viewpoint related to generation of the virtual viewpoint image based on captured images obtained by the plurality of cameras; and a determining unit for determining a position of the virtual object area to which a virtual object to be displayed in the virtual viewpoint image is disposed, based on the three-dimensional position of the specific object identified by the first identifying unit and the three-dimensional position of the virtual viewpoint identified by the second identifying unit.

Image processing apparatus, image generating method, and storage medium

A generation apparatus includes an acquisition unit configured to acquire shape data representing a shape of a subject based on a plurality of captured images obtained by a plurality of imaging apparatuses capturing the subject in an imaging region, a first determination unit configured to determine a subject position which is a position of the subject in the imaging region, a second determination unit configured to determine a reference position serving as a reference of the position of the subject, and a generation unit configured to generate, based on the shape data acquired by the acquisition unit, a virtual viewpoint image in accordance with a deviation between the subject position determined by the first determination unit and the reference position determined by the second determination unit.

Generation apparatus, generation method, and storage medium

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Information processing apparatus, image generation method, control method, and storage medium

A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.

Control device, control method, and program

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.

Information processing apparatus, image generation method, control method, and program

An information processing apparatus includes one or more memories storing instructions, and one or more processors executing the instructions to determine, among a plurality of captured images obtained by a plurality of image capturing apparatuses, a display target image related to a virtual viewpoint image, based on a position of a virtual viewpoint and a view direction from the virtual viewpoint, the virtual viewpoint image being generated based on the display target image and the position of the virtual viewpoint and the view direction from the virtual viewpoint, and to cause a displaying unit to display the determined display target image in a displaying mode according to a degree of contribution of the determined display target image to generation of the virtual viewpoint image.

Information processing apparatus, information processing method and storing unit

An image processing apparatus includes an obtaining unit configured to obtain virtual viewpoint information indicating a position and/or a direction of a virtual viewpoint corresponding to a virtual viewpoint image generated based on images captured by a plurality of cameras which capture images of a subject from different directions, and a display controller configured to display, while a first virtual viewpoint image corresponding to the virtual viewpoint information obtained by the obtaining unit is displayed on a display unit, a second virtual viewpoint image having an angle of view larger than an angle of view of the first virtual viewpoint image being displayed on the display unit, when an instruction for switching to a virtual viewpoint having a position and/or a direction which are/is not set by a user is received.

Image processing apparatus, image processing method, and storage medium

A video processing apparatus is provided that is controlled such that the display position of a cursor for a pointing type remote controller does not change when input is switched in a configuration where the video processing apparatus is connected to an external video apparatus. When input video data is switched, a controller transmits position information regarding the display position of a cursor image to the external video apparatus via a communication unit. The controller receives cursor image data generated by the external video apparatus from the external video apparatus and causes a cursor image, based on the cursor image data, to be displayed on a display unit, such that a cursor image after the input video data is switched is displayed at a position corresponding to the display position of a cursor image that has been displayed before the input video data is switched.

Growing community of inventors

Tokyo, Japan

Shogo Mizuno