Ricoh Company, Ltd.

Google Inc.

Other

Wanmin Wu

Kathrin Berkner

Ivana Tosic

Nikhil Balram

Noah Denis Bedard

Patrick Llull

Samuel Kvaalen

Ivana Tosić

Changchang Wu

Ivan Janatra

David Geoffrey Stork

M Dirk Robinson

Junlan Yang

Methods, systems, and media for rendering immersive video content with foveated meshes are provided. In some embodiments, the method comprises: receiving a video content item; determining, using a hardware processor, whether the video content item meets at least one criterion; in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; and storing the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh.

Methods, systems, and media for rendering immersive video content with foveated meshes

A mobile information gateway comprises: a wearable human interface module having an image delivery and display mechanism for presenting information overlaid upon a wide field of view, a computing and communication module adapted to send and receive information to and from the human interface module; and a backend service server coupled for processing medical data. The present invention also includes a method comprising: capturing information with a first mobile information gateway device; processing the captured information to determine an identity of a first user and authenticate the first user; processing the captured information to determine an identity of a patient and authenticate the patient; processing the identity of the first user and the identity of the patient to retrieve information of the patient; and resenting the retrieved information of the patient overlaid on a field of view by the first mobile information gateway device.

Mobile information gateway for use by medical personnel

A mobile information gateway comprises: a wearable human interface module having an image delivery and display mechanism for presenting information overlaid upon a wide field of view, a computing and communication module adapted receive information from the human interface module and adapted to send commands and information to the human interface module including information for presentation; and a backend service server coupled for processing data from the computing and communication module including user identification and verification. The present invention also includes a method comprising capturing information with a wearable human interface module; processing the captured information to determine an identity of a first customer; processing the identity of the first customer to retrieve information related to the first customer; and presenting the information related to the first customer with the wearable human interface module overlaid upon a field of view.

Mobile information gateway for customer identification and assignment

Multiframe reconstruction combines a set of acquired images into a reconstructed image. Here, which images to acquire are selected based at least in part on the content of previously acquired images. In one approach, a set of at least three images of an object are acquired at different acquisition settings. For at least one of the images in the set, the acquisition setting for the image is determined based at least in part on the content of previously acquired images. Multiframe image reconstruction, preferably via a multi-focal display, is applied to the set of acquired images to synthesize a reconstructed image of the object.

Adaptive image acquisition and display using multi-focal display

A multi-focal display represents a 3-dimensional scene by a series of 2-dimensional images located at different focal planes. The locations of the focal planes are selected based on an analysis of the three-dimensional scene to be rendered by the multi-focal display.

Content-adaptive multi-focal display

A multifocal display for rendering a 3D scene as a series of 2D images. In one aspect, the multifocal display includes a display, an optical imaging system, a refractive focus actuator and a controller. The display renders the 2D images. The optical imaging system is image-side telecentric and creates an image of the display. The refractive focus actuator is positioned at the pupil of the optical imaging system. Thus, adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image. The controller coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display. The waveform driving the focus actuator is preferably designed to reduce ringing and jitter effects.

Multifocal display

The disclosure includes a system and method for calibrating a binocular optical see-through augmented reality display. A calibration application renders one or more images of a virtual object on the one or more displays of the human interface device, and receives a user input to adjust a position of the one or more images on the one or more displays. In response to the input, the calibration application identifies a first and second boundary of a target range surrounding a real-world object at a first and second depth, respectively. The calibration application determines a first and second disparity corresponding to the first and second boundary and may record the disparities in relation to the depth of the real-world object.

Range calibration of a binocular optical augmented reality system

A mobile information gateway comprises: a wearable human interface module having an image delivery and display mechanism for presenting information overlaid upon a wide field of view, a computing and communication module adapted to send and receive information to and from the human interface module; and a backend service server coupled for processing data. The present invention also includes a method for using a mobile information gateway comprises: capturing information with a mobile information gateway device; processing the information captured by the mobile information gateway device to detect an emergency condition; analyzing the information captured by the mobile information gateway device to identify an emergency response; retrieving instructional information corresponding the emergency response; and providing the instructional information on the mobile information gateway device.

Mobile information gateway for use in emergency situations or with special equipment

A system and method for facilitating private user interaction is disclosed. The method comprises capturing information with a first mobile information gateway device; processing the captured information to determine an identity of a first user; processing the captured information to authenticate the first user; processing the identity of the first user to retrieve information of the first user; and presenting the retrieved information of the first user overlaid upon a first field of view by the first mobile information gateway device; and presenting the retrieved information to a second user overlaid upon a second field of view by the second mobile information gateway device.

Mobile information gateway for private customer interaction

The disclosure includes a system and method for calibrating a binocular optical see-through augmented reality display. A calibration application renders a virtual object to overlay and align with a real-world object on the display, receives a depth between the real-world object and the eyes of the user, receives user input to move the virtual object on the display for depth-disparity calibration, and determines a mapping between the depth and the disparity.

Depth-disparity calibration of a binocular optical augmented reality system

A mobile information gateway comprises a wearable human interface module having an image delivery and display mechanism for presenting information overlaid upon a wide field of view, a computing and communication module adapted receive information from the human interface module and adapted to send commands and information to the human interface module including information for presentation; and a backend service server coupled for processing data from the computing and communication module including user identification and verification. The present invention also includes a method for using the mobile information gateway for augmented use by employees interacting in the back office of a financial services company and comprises capturing information with a first human interface module; processing the information captured by the first human interface module; retrieving a set of shared information based upon the processing of the information captured by the first human interface module; presenting the shared set of information overlaid upon a field of view of the first user using the first human interface module; and presenting the shared set of information overlaid upon a field of view of the second user using a second human interface module.

Growing community of inventors

Redwood City, CA, United States of America

Wanmin Wu