Canon Kabushiki Kaisha

Toshikazu Ohshima

Hiroyuki Yamamoto

Shinji Uchiyama

Masakazu Fujiki

Toshihiro Kobayashi

Koichiro Wanda

Kiyohide Sato

Kiyohide Satoh

Kaname Tanimura

Takashi Morino

Kaname Tomite

Masahiro Suzuki

Akihiro Katayama

Kenji Morita

Naosato Taniguchi

Kazuki Takemoto

Yasuhiro Okuno

Mahoro Anabuki

Hiroki Yonezawa

Hideyuki Tamura

Tsuyoshi Kuroki

Rika Tanaka

Hiroyuki Kakuta

A method for combining a real space image with a virtual image, includes: causing an imaging unit to capture an image of a real space; generating an image covering a predetermined space based on a plurality of real images in the captured real space; extracting position information of a light source based on the generated image; and adding a light source or a shadow on the virtual image based on the extracted position information of the light source.

Method for calculating light source information and generating images combining real and virtual images

A CG image having a transparency parameter is superimposed on a shot image, which is an image picked up by an image-pickup device, to obtain a combined image. The combined image is displayed in a combined-image-display region. In the combined image, a mask region of the CG image is set based on parameter information used to extract a region of a hand. The transparency parameter of the CG image is set based on a ratio of the size of the region of the CG image excluding the mask region to the size of the shot image. By checking the combined image, which is displayed in the combined-image-display region, the user can set the parameter information by a simple operation.

Image processing method and image processing apparatus

An image processing method includes the steps of acquiring an image of a physical space, acquiring a position and orientation of a viewpoint of the image, generating an image of a virtual object, detecting an area which consists of pixels each having a predetermined pixel value, and superimposing the image of the virtual object on the image of the physical space. The superimposition step includes calculating a distance between a position of the virtual object and a position of the viewpoint, acquiring an instruction indicating whether or not the virtual object is emphasis-displayed, and setting a flag indicating whether or not the image of the virtual object is to be set as a masked target. The masking process image of the virtual object is superimposed or not on the image of the physical space depending if the image of the virtual object is set as the masked target.

A three-dimensional computer graphics model which represents a measurable range of a position and orientation sensor is prepared in advance. A composite image is generated by superimposing an image of a virtual object which represents the measurable range of the position and orientation sensor on an actually-sensed image in real space where the position and orientation sensor is placed. The composite image, when displayed, makes it possible to visually recognize the measurable range of the position and orientation sensor.

Image compositing method and apparatus for superimposing a computer graphics image on an actually-sensed image

An image processing method includes an object level acquisition step of acquiring an object level set for each computer graphics object, a display step of displaying a slide bar with a movable cursor to allow a user to set a user level by manipulating the cursor, and a user level acquisition step of acquiring a user level set by the user, based on a position of the cursor of the slide bar. In addition, a rendering step renders a virtual space including each computer graphics object by rendering each computer graphics object to have its visibility attribute depending on its object level acquired in the object level acquisition step and the user level. The rendering step renders a computer graphics object with an object level less than the user level as a visible object and renders a computer graphics object with an object level equal to or larger than the user level as an invisible object, and the rendering step is repeatedly performed in response to the position of the cursor being changed by the user.

Information processing method and image processing method

In a mixed-reality presentation system, a handler for manipulating a virtual object is displayed as a virtual object. Then, manipulation of the handler by the hand(s) of an observer is detected as manipulation of the virtual object associated with the handler, and those detection results are reflected in a display of the manipulated virtual object. By dynamically changing virtual objects displaying the handler according to the size of the virtual objects displayed in a view volume of the observer presented with a mixed reality space, the observer can select a desired virtual object with ease.

Mixed-reality presentation system and control method therefor

An information processing method of adjusting the position/orientation of a virtual object combined with a physical object includes steps of: acquiring position information of a virtual index defined on the virtual object; informing a user of the position of the virtual index; acquiring position information of a physical index on the physical object corresponding to the virtual index based on the position information of a pointing unit operated by the user; and defining position/orientation information of the virtual object based on the position information of the virtual index and the position information of the physical index.

Method and apparatus for processing information

When a plurality of mixed reality (MR) experiencing persons experience the same mixed reality, there is a possibility that the experiencing persons come into contact with one another. An image processing apparatus capable of reporting to the MR experiencing persons that there is a possibility of contact. Therefore, a real space image that is image captured from the position and orientation of a user's viewpoint is drawn. The position and orientation of the user's viewpoint at this time is detected by a sensor unit. It is determined whether or not the viewpoint position is smaller than or equal to an attention distance at which there is a possibility of contact. If the viewpoint position is smaller than or equal to the attention distance, an attention display for this fact is performed.

An acquired real image undergoes conversion based on a first parameter to generate an image corresponding to a designated characteristic. A virtual image is generated on the basis of a second parameter to generate an image corresponding to a designated characteristic. The converted real image is composited with the generated virtual image. The composite image is displayed.

Image processing apparatus, control method thereof, and program

There is provided an information processing method for setting the exclusive control right of a data item by a specific process in a system in which a plurality of clients connected via a network share data including a plurality of data items. In this method, when a desired data item is designated so as to set its exclusive control right, data items which belong to layers lower than the designated data and are related to the designated data item are retrieved on the basis of the hierarchical structure information of the plurality of data items. Then, the exclusive control right is set for the designated data item and retrieved data items.

Information processing method and apparatus

An information processing method maintains, in a system in which each of a plurality of client processes connected via an information transmission medium holds and uses shared data to be shared by the plurality of client processes, consistency of shared data held by the respective plurality of client processes. The method includes an input step of inputting a manipulation request, a determining step of determining a mode corresponding to the input manipulation request, from a plurality of modes including a first mode and a second mode, and a processing step of executing a process corresponding to the manipulation request in accordance with the mode determined in the determining step. The processing step includes a sending step of sending, when the manipulation request requests a manipulation of the shared data, request information that represents the manipulation request to a server process, a reception step of receiving response information corresponding to the request information sent in the sending step, from the server process, and a manipulation execution step of executing a manipulation for the shared data in accordance with the manipulation request or the response information received in the reception step.

Information processing method and apparatus maintaining consistency of shared data

An image combining method for combining an image obtained by image sensing real space with a computer-generated image and displaying the combined image. Mask area color information is determined based on a first real image including an object as the subject of mask area and a second real image not including the object, and the color information is registered. The mask area is extracted from the real image by using the registered mask area color information, and the real image and the computer-generated image are combined by using the mask area.

Correction of subject area detection information, and image combining apparatus and method using the correction

An information processing method for maintaining, in a system in which each of a plurality of client processes, connected via an information transmission medium, holds and uses shared data to be shared by the plurality of client processes, consistency of shared data held by the respective plurality of client processes, includes a holding step of holding the shared data, and a first issuance step of issuing, in response to a manipulation event request, a manipulation event that represents the manipulation to the shared data to the server process. In addition, a first manipulation execution step executes a manipulation to the shared data in response to a manipulation event received from the server process, and a second issuance step issues an issuance inhibition event to the server process. An inhibition step inhibits issuance of the manipulation event in the first issuance step after the issuance inhibition event is issued in the second issuance step until an event corresponding to the issuance inhibition event is received from the server process.

A video combining apparatus to superimpose a virtual image such a CG image on a video image of the real world or on a see-through type display device. An area in which the virtual image is not to be displayed can be easily designated by a user. If the user holds a frame with markers in his/her sight, the frame is image-sensed in the video image of the real world. The area designated by the user is detected by detecting the position of the marker in the video image, and the virtual image is not superimposed in this area.

Growing community of inventors

Kawasaki, Japan

Toshikazu Ohshima