Sony Corporation

Sony Interactive Entertainment Inc.

Sony Computer Entertainment Inc.

Sony Corporation Entertainment Inc.

Tetsugo Inada

Akio Ohba

Hiroyuki Segawa

Hirofumi Okamoto

Atsushi Kimura

Shoichi Ikenoue

Hidehiko Ogasawara

Masaki Uchida

Tatsuo Tsuchie

Hideshi Yamada

Osamu Watanabe

Daisuke Tahara

Yoshihiro Myokan

Yasuhiro Moriyama

Hirotoshi Maegawa

Takashi Kohashi

Takashi Itou

Yoshinori Ohashi

Takeshi Yamagishi

Takayuki Shinohara

Yuji Yamaguchi

Takayuki Ishida

Nobuo Sasaki

Tatsuki Kashitani

Takaaki Kato

Takumi Yoshida

Hideyuki Saito

Yutaka Yokokawa

Junichi Fujita

Akihiko Sugawara

Nicolas Doucet

Hiroshi Katoh

Junichi Muramoto

Jin Satoh

Kazuyuki Arimatsu

Tanio Nagasaki

Ayaka Nakatani

Jun Hiroi

Takahiro Koguchi

Hideaki Tomikawa

Teruyuki Nakahashi

Noriaki Shinoyama

Akihiro Takano

Norihide Kaneko

Provided is a system including an event-driven vision sensor including a sensor array in which a first sensor and a second sensor are arrayed in a predetermined pattern, the first sensor being configured to generate a first event signal when detecting a change in intensity of light larger than a first threshold, the second sensor being configured to generate a second event signal when detecting a change in intensity of light larger than a second threshold larger than the first threshold, and an information processing device including a first processing unit configured to execute first processing when the first event signal is received and the second event signal is not received, and a second processing unit configured to execute second processing different from the first processing when the second event signal is received.

System, information processing device, information processing method, and program

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the image of the user guide represents a state of the real space in which the user is physically located, as viewed obliquely.

Information processing apparatus and user guide presentation method

When a head-mounted display acquires data of a display image generated on the basis of position/posture information of a head of a user at time and given a distortion corresponding to the distortion of an eyepiece lens, the head-mounted display corrects the image on the basis of position/posture information of the head at time t for display. Then, the head-mounted display corrects chromatic aberrations on the basis of actual distortion coefficients of the lens, and outputs the image to a display panel.

Head-mounted display and image display method

An image generation device divides a distorted-image plane into pixel blocks in order to generate a distorted image in consideration of the distortion and chromatic aberration of an eyepiece. In the plane of a source image, the image generation device determines individual RGB sample positions included in the pixel blocks, sets a bounding rectangle containing the individual RGB sample positions, and determines, for example, computation target pixels corresponding to the bounding rectangle. The image generation device calculates the pixel values of, for example, the computation target pixels, interpolates and samples the calculated pixel values, and regards the results of interpolation and sampling as the pixel values of the distorted image.

Image generation device and image generation method

A position detection system includes an event-driven vision sensor that includes a sensor array including sensors each generating an event signal when a change in the intensity of incident light is detected, a microlens array that includes at least first and second microlenses for guiding the light to first and second regions of the sensor array, respectively, and a terminal device that has a reception unit for receiving the event signal from the vision sensor and a position detection unit for detecting the three-dimensional position of the change in the intensity of light, from the event signal generated by each sensor in the first region and the second region.

Position detection system, image processing device, position detection method, and position detection program

Pulsed light emitted from a light emitter of a TOF sensor at an intensity is divided into light that is reflected by an object having transmissivity and reaches a light receiver at an intensity and light that passes through the object and reaches an object at an intensity. The latter is reflected by the object at an intensity, partly passing through the object to reach the light receiver at an intensity. A local maximum point is detected in a change in a degree of photons observed by the light receiver, to acquire both distances to the object and the object.

Position information acquisition device, head-mounted display, and position information acquisition method

Provided is a system that includes an event-driven vision sensor and an information processing device. The event-driven vision sensor includes a sensor array where a first sensor and a second sensor are arranged in a predetermined pattern. The first sensor generates a first event signal when detecting a change in an intensity of light incident through a first filter. The first filter selectively passes light in a first wavelength band. The second sensor generates a second event signal when detecting a change in an intensity of light incident through a second filter. The second filter selectively passes light in a second wavelength band that is different from the first wavelength band. The information processing device includes a first processing section and a second processing section. The first processing section executes a first process on the basis of the first event signal. The second processing section executes a second process different from the first process on the basis of the second event signal.

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the generating and outputting data of the image of the user guide includes determining whether to display the user guide in response to certain criteria.

An image generation apparatusincludes a distortion information storage sectionthat stores, as distortion information, information for deforming and distorting an image, and a distortion rendering sectionthat renders a distorted image by rasterization processing using the distortion information without generating a non-distorted image in a memory. The distortion rendering sectionrenders the distorted image by executing the rasterization processing on a distorted triangle obtained by transforming a triangle to be rasterized on the basis of the distortion information such that the processing is executed upward and downward from positions of vertices of the distorted triangle.

Image generation apparatus and image generation method

Methods and apparatus provide for acquiring position information about a head-mounted display; performing information processing using the position information about the head-mounted display; generating and outputting data of an image to be displayed as a result of the information processing; and generating and outputting data of an image of a user guide indicating position information about a user in a real space using the position information about the head-mounted display, where the generating and outputting data of the image of the user guide includes determining whether to display the user guide in response to one of: (i) a user operation, and (ii) regardless of the user operation.

Provided is a calibration apparatus that performs calibration by using a captured image of a chart including a plurality of plane surfaces forming a predetermined angle &#x3b8;. An imaging apparatus simultaneously images chart patterns depicted on each of the plane surfaces of the chart. In this instance, the chart pattern depicted on each of the plane surfaces of the chart is inversely projected in accordance with a distance from an imaging plane such that patterns in which feature points are uniformly distributed within the captured image are obtained.

Calibration apparatus, chart for calibration, chart pattern generation apparatus, and calibration method

As a user guide, the state of overlooking a real space including an imaging device and a user is presented by one of two images: an image in reference to the position of the imaging device, or an image in reference to the user's direction. In both images, a rectangle indicative of the imaging device and a circle representative of the user are presented in a manner reflecting the actual positional relations and directions involved. Also presented are an area denoting a play area in the horizontal direction determined by a camera angle of view for example, and an arrow pointing to the direction in which the user is to move.

An operation object includes a polyhedron. The polyhedron includes characteristic surfaces formed by cutting each vertex of a cube at different angles. An information processing apparatus acquires a normal vector of each surface from a polarized image thereof. Further, the information processing apparatus identifies the characteristic surface by defining, as a characteristic amount, an angle formed by an average vector Nof normal vectors N, N, and Nof reference surfaces that orthogonally intersect each other and a normal vector Nof the characteristic surface surrounded by the reference surfaces. The specification result and the normal vectors thereof are used to acquire the position and orientation of the operation object.

Information processing apparatus, information processing system, operation object, and information processing method

[Object] To perform more stable and highly accurate attitude estimation. [Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.

Image processing device and method

An image acquisition block of an information processing apparatus acquires stereo images taken by a first camera and a second camera that make up an imaging apparatus. An input information acquisition block accepts a user manipulation. A first positional information acquisition block of a positional information generation block identifies an approximate position of an object to be imaged through predetermined means. A second positional information acquisition block determines an estimated distance range of a target on the basis of the identified approximate position of the object to be imaged, detects corresponding points by executing block matching on stereo images thorough only a search range corresponding to the determined estimated distance range, and obtains a position of the target with high resolution and accuracy. An output information generation block generates output data on the basis of the position of that target and outputs the generated output data.

Growing community of inventors

Kanagawa, Japan

Tetsugo Inada