Canon Kabushiki Kaisha

Mitsubishi Denki Kabushiki Kaisha

Nissan Motor Company Limited

The University of Tokyo

Akihiro Matsushita

Kenichi Fujii

Atsushi Date

Michio Aizawa

Tomohiro Yano

Masahiro Handa

Katsumasa Tanaka

Shogo Mizuno

Keisuke Morisawa

Mai Komiyama

Kiwamu Kobayashi

Katsuyuki Kobayashi

Takashi Okazaki

Yoshihiro Sumida

Itsutarou Akiyama

Hajime Sato

Yuichiro Yoshimura

Takayuki Yoshida

Yukihiko Sakashita

Hiroaki Ishikawa

Satoru Kotoh

Takayuki Hashimoto

Takashi Sunda

Takayuki Komine

Tomoko Suzuki

Naoki Umemura

Akio Fukushima

Ritsuo Machii

Takuto Kawahara

Hirokuni Takano

Masataka Kabuki

Kazunobu Jojima

Jun Hashimoto

Akihiro Ouchi

Yoshihiko Nakamura

Keijiro Iwao

Kenya Uenuma

Shigehiro Kadota

Yasuyuki Arai

Youji Shimizu

Mitsuhito Ito

Yasuo Sone

Yasunori Shida

Akinori Toyoda

Wataru Takano

Katsunori Okada

Yoshikazu Hatano

Hiroto Nakashima

Hiroyuki Oohara

A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.

Method for generating virtual viewpoint image and image processing apparatus

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Information processing apparatus, image generation method, control method, and storage medium

Provided is an image processing apparatus comprising: one or more memories that store a set of instructions; and one or more processors that execute the instructions to obtain a plurality of inputted images that are contiguously captured, perform determination of a first region based on the obtained inputted images, the first region being formed from pixels each having a change in pixel value below a predetermined threshold in a predetermined period, the determination being performed in each of a plurality of the continuous predetermined periods, determine a second region based on a plurality of the first regions determined in the plurality of the continuous predetermined periods, respectively, determine a third region by subjecting image data representing the determined second region to image processing, and update a background image based on the obtained inputted images and any of the determined third region.

Image processing apparatus, method of controlling image processing apparatus, and storage medium

A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.

Control device, control method, and program

An image processing apparatus generates an image indicating a foreground area of a captured image, based on (i) a threshold value corresponding to both luminance difference between the captured image and a background image and luminance of one of the captured image and the background image, (ii) obtained luminance of one of the captured image and the background image, and (iii) obtained luminance difference between the captured image and the background image.

Image processing apparatus, image processing method, and a non-transitory computer readable storage medium

An image processing apparatusincludes: a first saturation information obtaining unitconfigured to obtain saturation of a frame image; a second saturation information obtaining unitconfigured to obtain saturation of a background image; and a threshold value determining unitconfigured to determine a threshold value, which is used for checking a difference in color information, for each pixel, based on the saturation obtained by each of the first saturation information obtaining unitand the second saturation information obtaining unit. A hue foreground area estimating unitis configured to estimate a foreground area by use of the threshold value determined by the threshold value determining unitas well as color information of the frame image and color information of the background image.

Image processing apparatus, image processing method, and storage medium

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.

Information processing apparatus, image generation method, control method, and program

A virtual viewpoint image generation system generates a virtual viewpoint image based on a plurality of captured images obtained by capturing an image capturing target region from a plurality of different directions, and position information relating to a virtual viewpoint position. The system comprises: a plurality of image capturing apparatuses; a daisy-chain-type topology network; an obtainment unit configured to obtain the position information relating to the virtual viewpoint position; and a generation unit configured to generate the virtual viewpoint image based on the position information and the data based on each captured image of the plurality of image capturing apparatuses obtained via the daisy-chain-type topology network.

Virtual viewpoint image generation system based on captured images, virtual viewpoint image generation apparatus, and method of controlling same

An image processing apparatus that generates a virtual viewpoint image based on one or more captured images out of a plurality of captured images by a plurality of cameras, the apparatus comprising an acquisition unit configured to acquire virtual viewpoint information including information related to a position and a direction of a virtual viewpoint, a determination unit configured to determine whether occlusion is occurring in at least one image captured by at least one of the cameras, a decision unit configured to, based on a position and direction of the virtual viewpoint and on a result of the occlusion determination in relation to the at least one image, decide one or more captured images to be used for generation of a virtual viewpoint image, and a generation unit configured to generate a virtual viewpoint image using the decided one or more captured images.

Image processing apparatus that generates a virtual viewpoint image, image generation method, and non-transitory computer-readable storage medium

A driving assistance system has a driving information acquisition unit that acquires any of an amount of operations by a driver, a vehicle behavior, a state of the driver, and information regarding the environment surrounding a vehicle as driving information, a vehicle location information acquisition unit that acquires vehicle location information, a statistical information generation unit that generates statistical information by statistically processing the driving information as a time-series pattern, an information associating unit that associates the statistical information with the vehicle location information at the time of the acquisition of the driving information, an information reference unit that references and reads the statistical information based on the location information acquired by the vehicle location information acquisition unit, a driving assistance unit that performs driving assistance based on the statistical information read by the information reference unit, and a communication unit.

Driving assistance system and driving assistance method

A coordinate input apparatus detects a specified position in a coordinate-input effective area using a light projector that projects light onto a coordinate input surface and a plurality of light receptors that receive the light projected by the light projector. The coordinate input apparatus sets a first coordinate system based on a positional relationship between two light receptors constituting a first combination of the plurality of light receptors and a second coordinate system based on a positional relationship between two light receptors constituting a second combination that is different from the first combination, and converts a coordinate value of the specified position detected using the second coordinate system into a coordinate value in the first coordinate system.

Coordinate input apparatus, control method thereof, and non-transitory computer-readable storage medium

A coordinate input apparatus which detects a position pointed in a region surrounded by at least four sensor units, based on detection outputs from two sensor units corresponding to the pointed position out of the at least four sensor units stores, in a memory unit, correction values which are based on respective detection outputs of a plurality of combinations each of two sensor units out of the at least four sensor units for one position corresponding to the plurality of combinations, and calculates the pointed position based on the detection outputs from two sensor units corresponding to the pointed position, and the correction values stored in the memory unit.

Coordinate input apparatus, method thereof, and storage medium

Growing community of inventors

Tokyo, Japan

Akihiro Matsushita