Sony Interactive Entertainment America LLC

Sony Computer Entertainment America LLC

Sony Interactive Entertainment Inc.

Thomas Miller

George Weising

Methods, systems, and computer programs are provided for generating an interactive space. One method includes identifying a reference point in a three-dimensional (3D) space using a portable device. The reference point is calibrated to an origin point of the portable device. The method includes determining by the device a position and an orientation of the portable device at the origin point. The position and orientation is determined using data from an inertial sensor of the portable device and data from the camera. The method includes generating by the portable device an augmented reality (AR) space using the reference point. The AR space includes virtual objects imposed over or in the 3D space.

Tracking position of device inside-out for augmented reality interactivity

Methods, systems, and computer programs are provided for generating an interactive space. One method includes operations for associating a first device to a reference point in 3D space, and for calculating by the first device a position of the first device in the 3D space based on inertial information captured by the first device and utilizing dead reckoning. Further, the method includes operations for capturing images with a camera of the first device, and for identifying locations of one or more static features in the images. The position of the first device is corrected based on the identified locations of the one or more static features, and a view of an interactive scene is presented in a display of the first device, where the interactive scene is tied to the reference point and includes virtual objects.

Tracking position of device inside-out for virtual reality interactivity

Methods, apparatus, and computer programs for controlling a view of a virtual scene with a handheld device are presented. In one method, images of a real world scene are captured using a device. The method further includes operations for creating an augmented view for presentation on a display of the device by augmenting the images with virtual reality objects, and for detecting a hand in the images as extending into the real world scene. In addition, the method includes operations for showing the hand in the screen as detected in the images, and for generating interaction data, based on an interaction of the hand with a virtual reality object, when the hand makes virtual contact in the augmented view with the virtual reality object. The augmented view is updated based on the interaction data, which simulates on the screen that the hand is interacting with the virtual reality object.

Maintaining multiple views on a shared stable virtual space

A method comprising: detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene; generating an augmented reality scene formed by inserting a virtual character into the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device; displaying the augmented reality scene on a display; wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.

Method for an augmented reality character to maintain and exhibit awareness of an observer

Methods and systems for enabling an augmented reality character to maintain and exhibit awareness of an observer are provided. A portable device held by a user is utilized to capture an image stream of a real environment, and generate an augmented reality image stream which includes a virtual character. The augmented reality image stream is displayed on the portable device to the user. As the user maneuvers the portable device, its position and movement are continuously tracked. The virtual character is configured to demonstrate awareness of the user by, for example, adjusting its gaze so as to look in the direction of the portable device.

Calibration of portable devices in a shared virtual space

Ways for controlling a virtual-scene view in a portable device are presented. In one method, a signal is received and the device is synchronized to make the location of the device a reference point in a three-dimensional (3D) space. A virtual scene with virtual reality elements is generated around the reference point. The current position of the device in the 3D space, with respect to the reference point, is determined and a view of the virtual scene created. The view represents the virtual scene as seen from the current position of the device with a viewing angle based on the position of the device. The created view is displayed in the device, and the view of the virtual scene is changed as the device is moved within the 3D space. In another method, multiple players shared the virtual reality and interact with each other in the virtual reality.

Methods, systems, and computer programs for generating an interactive space, viewable through at least a first and a second handheld devices, are presented. The method includes an operation for taking an image with a camera in the first device. In addition, the method includes an operation for determining a relative position of the second device with reference to the first device, based on image analysis of the taken image to identify a geometry of the second device. Furthermore, the method includes operations for identifying a reference point in a three-dimensional (3D) space based on the relative position, and for generating views of an interactive scene in corresponding displays of the first device and the second device. The interactive scene is tied to the reference point and includes virtual objects, and each view shows all or part of the interactive scene as observed from a current location of the corresponding device.

Methods, systems, and computer programs for generating an interactive space viewable through at least a first and a second device are presented. The method includes an operation for detecting from the first device a location of the second device or vice versa. Further, synchronization information data is exchanged between the first and the second device to identify a reference point in a three-dimensional (3D) space relative to the physical location of the devices in the 3D space. The devices establish the physical location in the 3D space of the other device when setting the reference point. The method further includes an operation for generating views of an interactive scene in the displays of the first and second devices. The interactive scene is tied to the reference point and includes virtual objects. The view in the display shows the interactive scene as observed from the current location of the corresponding device. Moving the device in the 3D space causes the view to change according to the perspective from the current location.

Growing community of inventors

Los Angeles, CA, United States of America

Thomas Miller