Sony Computer Entertainment Inc.

Sony Interactive Entertainment Inc.

Sony Corporation

Tokyo Institute of Technology

Tomokazu Kake

Akira Suzuki

Akio Ohba

Satoshi Nakajima

Takayuki Ishida

Yasuhiro Watari

Yousuke Kimoto

Hiromasa Horie

Hiroyuki Segawa

Yasushi Okumura

Masakazu Suzuoki

Takahiro Fujii

Shigeru Enomoto

Shuji Hiramatsu

Muneki Shimada

Kenjiro Komaki

Katsu Saito

Toyoshi Okada

Keiso Shimakawa

Yuta Kimura

Hidehisa Onai

Tadashi Nakamura

Takeshi Yamagishi

Hiroaki Ishida

Keiji Togawa

Michinari Kohno

Shinichi Honda

Shigeo Hirose

Yukari Konishi

Takuya Kuji

Tsutomu Kouno

Tsubasa Umeki

Kensuke Kita

Hiroya Matsugami

Tatsuaki Hashimoto

Kazuteru Fukayama

Kentarou Suzuki

Yuki Kon

Provided is a control apparatus connected to an operating apparatus and to an information processing apparatus. The operating apparatus receives an operation performed by a user. The information processing apparatus performs information processing based on an operation performed by the user at the operating apparatus. The control apparatus receives operation-related information indicating an operation performed by the user at the operating apparatus, acquires setting information regarding an operation content receivable by the operating apparatus, processes the received operation-related information according to the acquired setting information, and outputs the processed operation-related information to the information processing apparatus.

Information processing system, control apparatus, medium, control method, and program

Methods and apparatus provide for: generating virtual space images by specifying from among a plurality of viewpoint positions and a plurality of directions of line of sight in the virtual space; and displaying the virtual space images on a head-mounted display, where the generating includes changing from a currently selected viewpoint position among the plurality of viewpoint positions to a newly selected viewpoint position among the plurality of viewpoint positions, which is selected in accordance with operation by a user, when generating the virtual space images in response to changing to the newly selected viewpoint position, the display control section specifies a new direction of line of sight among the plurality of directions of line of sight, and at least some of the plurality of viewpoint positions are separated from each other.

Display control apparatus and display control method

Methods and apparatus provide for: generating virtual space images by specifying from among a plurality of viewpoint positions and a plurality of directions of line of sight in the virtual space; and displaying the virtual space images on a head-mounted display, where the generating includes changing from a currently selected viewpoint position among the plurality of viewpoint positions to a newly selected viewpoint position among the plurality of viewpoint positions, which is selected in accordance with operation by a user, when generating the virtual space images in response to changing to the newly selected viewpoint position, the generating includes specifying, as a new direction of line of sight among the plurality of directions of line of sight, a direction in which a first position in the virtual space is seen from the newly selected viewpoint position, and at least some of the plurality of viewpoint positions are separated from each other.

An information processing apparatus constructs a virtual space to express a subject by acquiring an image obtained by observing a reality space in which one or more subjects are present, and arranging a plurality of unit volume elements at positions that are determined depending on a subject captured in the acquired image, and the information processing apparatus constructs a virtual space by arranging multiple types of unit volume elements with different sizes.

Information processing apparatus

An information processing apparatus acquires, in regard to a subject in a three-dimensional space, unit element information including information regarding a position, in the space, of each of plural unit elements configuring the subject, draws a space image indicative of a state of a virtual space in which the plural unit elements are arranged using the unit element information, and specifies a posture of the subject in the three-dimensional space on the basis of a result obtained by executing a posture estimation process targeting a two-dimensional image for the drawn space image.

A display control apparatus includes a display control section that generates a virtual space image by specifying a viewpoint position and a direction of line of sight and displays the image on a head-mounted display. The display control section can specify a plurality of positions in the virtual space as viewpoint positions and can change the viewpoint position to a position determined from among the plurality of positions in accordance with an attitude of the head-mounted display, and when the viewpoint position is changed, the display control section specifies, as a direction of line of sight, the direction in which a first position in the virtual space is seen from the changed viewpoint position.

An image processing apparatus connected to a display device to be mounted on the head of a user acquires panoramic image data representing a captured image around the user and generates background image data representing the panoramic image data projected onto a projection plane having a predetermined shape that is virtually disposed around the position of a user's viewpoint in a virtual space. The image processing apparatus synthesizes model image data generated on the basis of predetermined three-dimensional model data with the background image data, thereby generating synthesized image data, and outputs a visual field image of the user generated on the basis of the synthesized image data to the display device.

Image display system, image display device, control method therefor, and program

An information processing apparatus that constructs a virtual space by acquiring a plurality of images obtained by observing, at different times, a reality space in which one or more subjects are present, and arranging a plurality of unit volume elements at positions determined depending on a subject captured in each image of the plurality of images.

An information processing apparatus is provided that allows a user to execute, when a video image is displayed on a video image display apparatus worn on the head of the user, interactions with video images more intuitively. An information processing apparatus, connected to a video image display apparatusworn on the head of a user, acquires information of a relative position of at least a part of the body of the user with reference to a position of the video image display apparatusand displays, on the video image display apparatus, a video image indicative of a situation in which an object corresponding to the part is arranged at a position in a virtual space, the position being determined in accordance with the acquired relative position.

A gaming apparatus includes a position control section and a display control section. The position control section controls a position of an object arranged in a virtual 3D space based on a relative position between an input apparatus used by a user wearing a head-mounted display and the head-mounted display. The display control section generates an image in the virtual 3D space including the object and displays the image on the head-mounted display. When a distance between the input apparatus and the head-mounted display is equal to a first distance or more, the position control section linearly changes the object position in response to a change in position of the input apparatus. When the distance between the input apparatus and the head-mounted display is less than the first distance, the position control section determines the object position in accordance with a criterion different from that used when the distance between the input apparatus and the head-mounted display is equal to the first distance or more.

In an interface apparatus for presenting a force sense at a remote place or in a virtual space to a user, the number of motors for exerting force upon fingers of the user is decreased. The interface apparatus includes a first arm and a second arm for being attached to the thumb and a finger other than the thumb, respectively. A motor includes a motor main body supported for rotation, and a rotary shaft that relatively rotates with respect to the motor main body. The rotary shaft is connected to the second arm. The motor main body is connected to the first arm so as to impart rotation thereof to the first arm.

Interface apparatus

A data processing technology of high convenience is provided. A data processing apparatus includes: a data file storing section which stores data files; a user interface section which assigns first objects to respective data units, displays the first objects on-screen, and accepts an operation on the data units in the form of an operation on the first objects, the data units each being a data file or a group of a plurality of data files stored in the data file storing section; and a grouping section which accepts an operation for instructing to group a plurality of the data units, groups those data units together, and determines attribute information pertaining to contents of the group and attaches it to the group based on pieces of attribute information attached to the respective data units, pertaining to contents of the data units.

User interface for processing data by utilizing attribute information on data

A data processing technology provides improved convenience. A user interface unit assigns a first object to a data file and displays the object on a screen. The unit also assigns a second object to an application processing the data file and displaying the object on the screen. When an operation to allow the first object to affect the second object is accepted, a notifying unit notifies the application of the direction or speed of the operation. The operation determining unit determines an operation performed in processing the data file, based an the direction or speed.

User interface in which object is assigned to data file and application

A controller interface processor of a user interface apparatus acquires the tilt of a game controller as a rotational value from a sensor built in the game controller. An operation amount determining unit selects a sensitivity characteristic pattern from a plurality of sensitivity characteristic patterns different in the reaction sensitivity of an operation amount with respect to the rotational value in accordance with the width of a range of the rotational value, refers to the selected sensitivity characteristic pattern, and determines the operation amount corresponding to the rotational value acquired.

User interface apparatus and operational sensitivity adjusting method

To control screen display using moving pictures for a plurality of users. Respective moving pictures for a plurality of users are acquired, and each of the acquired moving pictures are displayed on a screen. Display content for the screen is controlled in response to content of each moving picture. At this time, it is also possible to move a specified movement image on the screen according to display position of each moving picture on the screen and content of each moving picture, or to change a display region of the moving picture on the screen according to content of each moving picture.

Growing community of inventors

Tokyo, Japan

Tomokazu Kake