Canon Kabushiki Kaisha

Michio Aizawa

Atsushi Date

Kenichi Fujii

Akihiro Matsushita

Tomohiro Yano

Masahiro Handa

Katsumasa Tanaka

Shogo Mizuno

Keisuke Morisawa

Mai Komiyama

Toshiaki Fukada

Masayuki Yamada

Yasuo Okutani

Tsuyoshi Yagisawa

Makoto Hirota

Yasuhiro Komori

Hitoshi Aoki

Keiichi Sakai

Kazue Kaneko

Minoru Fujita

Shinichiro Uno

Keigo Yoneda

Yoichi Kazama

Yasushi Shikata

A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.

Method for generating virtual viewpoint image and image processing apparatus

An arrangement determination apparatus for determining an arrangement of a plurality of cameras that is used for generation of a virtual viewpoint image acquires information indicating an imaging target region, and determines an arrangement of the plurality of cameras based on the information in such a manner that images of the entire region of the imaging target region are captured by two or more cameras of the plurality of cameras and images of the entire region of the imaging target region are captured by different two or more cameras of the plurality of cameras that are different from the two or more cameras.

Arrangement determination apparatus, system, arrangement determination method, and recording medium

An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.

Image processing apparatus, image processing method, and storage medium

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Information processing apparatus, image generation method, control method, and storage medium

An information processing apparatus is configured to perform at least based on a first parameter set according to an operation on a first operation unit, and also based on an operation on a second operation unit, changing at least either of a position and a direction of a virtual viewpoint corresponding to a virtual viewpoint image, receiving a switching input for switching a parameter set according to an operation on the first operation unit from the first parameter to a second parameter, and based on the second parameter set according to an operation on the first operation unit performed after the switching input is received, and also based on an operation on the second operation unit, changing at least either of the position and the direction of the virtual viewpoint.

Information processing apparatus and information processing method for generating a virtual viewpoint

A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.

Control device, control method, and program

An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.

Information processing apparatus, information processing method, and computer readable storage medium for determining a moving path of virtual viewpoint

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.

Information processing apparatus, image generation method, control method, and program

An image processing apparatus includes an obtaining unit configured to obtain identification information for identifying a restriction area which is set in a three-dimensional coordinate system, the restriction area being an area in which display of a virtual object inserted in a virtual viewpoint image based on captured images obtained by a plurality of cameras that capture images in different angles and viewpoint information corresponding to a specification of a virtual viewpoint is restricted, wherein the virtual object is not included in the captured images obtained by the plurality of cameras, and a control unit configured to restrict the display of the virtual object in the virtual viewpoint image so that the display of the virtual object being in the restriction area, which is identified by the identification information obtained by the obtaining unit, is restricted.

An information processing apparatus receives input operation information by an operation unit configured to successively perform a moving operation for a position and/or orientation of a virtual viewpoint for generating a virtual-viewpoint image, switches the virtual viewpoint to another virtual viewpoint located at a position spatially separated from a position of the virtual viewpoint and having an image-capturing space common to the virtual viewpoint, and determines, if the virtual viewpoint is switched, a motion of the other virtual viewpoint after the switching in accordance with a motion of the virtual viewpoint based on the operation information before the switching.

Information processing apparatus, control method therefor, and non-transitory computer-readable storage medium

A portable information processing device, including a main body comprising a projector configured to project an image; a state detection unit configured to detect a state of the main body; and an output control unit configured to control an output of the projector based on the state of the main body detected by the state detection unit.

Portable information processing device, output control method for a projector, and recording medium

The information processing apparatus performs a voice communication with a counterpart device which comprises a voice communication function through a voice communication unit. The information processing apparatus performs voice recognition processing of first voice and second voice, the first voice is the voice which is transmitted to the counterpart device by a voice communication through the voice communication unit, the second voice is the voice which is input from the counterpart device, and searches one or more applications according to a recognition result of the voice recognition unit. The information processing apparatus displays an object for starting the application searched on a display section. Thereby, the information processing apparatus prevents starting the application which is not intended by the user.

Growing community of inventors

Yokohama, Japan

Michio Aizawa