Pcms Holdings, Inc.

Interdigital Vc Holdings, Inc.

Other

Seppo T Valli

Pekka K Siltanen

Ralph Neff

Louis Joseph Kerofsky

Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.

Method and system for near-eye focal plane overlays for 3D perception of content on 2D displays

Disclosed herein are systems and methods for augmented reality multi-view telepresence. An embodiment takes the form of a method that includes obtaining a session geometry of a multi-location telepresence session that includes a first-location participant at a first location and a second-location participant at a second location, each location having respective pluralities of cameras and display segments. The method includes selecting, according to the session geometry, both a first-to-second-viewpoint second-location camera from the plurality of second-location cameras as well as a first-to-second-viewpoint first-location display segment from the plurality of first-location display segments. The method includes receiving a first-to-second-viewpoint video stream captured by the selected first-to-second-viewpoint second-location camera, and further includes generating a line-of-sight augmented-reality experience for the multi-location telepresence session at least in part by rendering the received first-to-second-viewpoint video stream via the selected first-to-second-viewpoint first-location display segment.

System and method for augmented reality multi-view telepresence

Some embodiments of an example method may include receiving an input image with depth information; mapping the input image to a set of focal plane images; orienting the set of focal plane images using head orientation information to provide stereo disparity between left and right eyes; and displaying the oriented set of focal plane images. Some embodiments of another example method may include: receiving a description of three-dimensional (3D) content; receiving, from a tracker, information indicating motion of a viewer relative to a real-world environment; responsive to receiving the information indicating motion of the viewer, synthesizing motion parallax by altering multi-focal planes of the 3D content; and rendering an image to the multi-focal plane display using the altered multi-focal plane rendering.

Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)

Systems and methods are described for display of a depth image (depth plus texture) using multiple focal planes. In one embodiment, a depth image (which may be a frame of a depth video, consisting of a video plus depth sequence) is mapped to a first set of image planes. The depth image (or a subsequent frame of the depth video) is mapped to a second set of image planes. Each image plane in the first and second set has a specified depth, and the first and second set differ in at least one depth. Each of the image planes is displayed in the first set at the respective depth of that image plane, and, subsequently, each of the image planes in the second set is displayed at its respective depth. Display of the first and second sets may be cyclically alternated at rate sufficiently high to avoid perceptible flicker.

Multi-focal planes with varying positions

Augmented reality (AR) telepresence systems and methods are disclosed for obtaining a 3D model of a physical location from a 3D-capture system comprising one or more 3D depth sensors disposed throughout the physical location, generating a truncated 3D model of the physical location, the truncated 3D model corresponding to the intersection of the generated 3D model and a field of view of a user terminal camera at the physical location, and transmitting the truncated 3D model to a remote location.

Apparatus and method for supporting interactive augmented reality functionalities

Systems and methods are described that enable a 3D telepresence. In an exemplary method, a 3D image stream is generated of a first participant in a virtual meeting. A virtual meeting room is generated. The virtual meeting room includes a virtual window, and the 3D image stream is reconstructed in the virtual window. The first participant thus appears as a 3D presence within the virtual window. The virtual meeting room may also include virtual windows providing 3D views of other participants in the virtual meeting and may further include avatars of other meeting participants and/or of the first meeting participant.

System and method for 3D telepresence

Systems and methods described herein are provided for managing user positions in a shared virtual geometry, capturing 360&#xb0; views of a local user environment in a spatially faithful system, and computing a perspective view of a first user from the eye-point of a second user. Users may move around the shared virtual geometry, and perspective views of users may be updated. Some embodiments use a co-centric geometry for group conferencing with other users. Some embodiments may use a grid-based geometry for exploration with other users. Some embodiments may reduce transferred bitrates to enable systems and methods to be implemented in data-limited environments. Some embodiments support users moving and navigating a shared virtual geometry.

Spatially faithful telepresence supporting varying geometries and moving users

Disclosed are systems and methods for augmented reality multi-view telepresence. An exemplary embodiment is provided for a first-location participant and a second-location participant, each location having respective pluralities of cameras and display segments. A session geometry of a multi-location telepresence session is obtained for the participants. According to the session geometry, a selection is made of a first-to-second-viewpoint second-location camera from among the second-location cameras and a first-to-second-viewpoint first-location display segment from among the plurality of first-location display segments. A first-to-second-viewpoint video stream captured by the selected first-to-second-viewpoint second-location camera is received, and a line-of-sight augmented-reality session is generated by rendering the received first-to-second-viewpoint video stream via the selected first-to-second-view-point first-location display segment.

Growing community of inventors

Espoo, Finland

Seppo T Valli