Tanzle, Inc.

Zspace, Inc.

Infinite Z, Inc.

Nancy L Clemens

Michael A Vesely

Alan S Gray

A system, method or compute program product for displaying a first image based on first image data in a display area of a first display device, receiving at least one camera-captured second image of an environment with the second image capturing at least a portion of the first image displayed in the display area, determining a location and orientation of the first display device relative to the camera, determining a portion of the second image that corresponds to the portion of the first image displayed in the display area, generating a third image that corresponds to the portion of the first image displayed on the first display device as viewed from a point of view of the camera from the first image data, and generating a composite image of the environment by replacing at least a portion of the second image with the third image, and displaying the composite image.

Integrated display rendering

A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

Perspective based green screening

A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Frustum change in projection stereo rendering

A system, method or compute program product for generating composite images. One of the systems includes a capture device to capture an image of a physical environment; and one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to: obtain an image of the physical environment as captured by the capture device, identify a visually-demarked region on a surface in the physical environment as depicted in the image, process the image to generate a composite image of the physical environment that includes a depiction of a virtual object, wherein a location of the depiction of the virtual object in the composite image is based on a location of the depiction of the visually-demarked region in the image, and cause the composite image to be displayed for a user.

Generating composite stereoscopic images

A system, method or compute program product for integrating two or more displays. One of the systems includes a stereoscopic first display; a monoscopic second display; and one or more computers configured to perform operations including receiving first data representing a 3D scene including at least one virtual 3D object, receiving second data related to the at least one virtual 3D object, obtaining third data representing the position and/or orientation of the second display relative to position and/or orientation of the first display, based on the first data, rendering the 3D scene including the at least one virtual object as a stereoscopic image on the stereoscopic first display, and based on the second data, rendering a 2D object on the monoscopic second display with the rendering varying based on the position and orientation of the second display relative to the first display provided by the third data.

Generating composite stereoscopic images usually visually-demarked regions of surfaces

A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustrum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustrum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustrum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Modifying perspective of stereoscopic images provided by one or more displays based on changes in user viewpoint. The one or more displays may include a first display that is provided substantially horizontal for displaying 3D horizontal perspective images and/or a second display that is provided substantially vertical for displaying text or conventional images such as 2D images, or 3D vertical perspective images. The horizontal display surface may be typically positioned directly in front of the user, and at a height of about a desktop surface so that the user can have about a 45&#xb0; looking angle. The vertical display surface may be positioned in front of the user and preferably behind and above the horizontal display surface.

Growing community of inventors

Scotts Valley, CA, United States of America

Nancy L Clemens