Fuji Xerox Co., Ltd.

James Vaughan

Donald G Kimber

Sven Kratz

Jun Shingu

Anthony Dunnigan

Eleanor Rieffel

Pernilla Quarfordt

Ryota Mizutani

David Lee

Kathleen Tuite

Chong Chen

Sagar Gattepally

Example implementations described herein are directed to systems and methods for providing a panoramic video connection between one location and another, or between one location and a number of distributed remote viewers, which provides reciprocity in terms of awareness of who is viewing and what they are looking at. In example implementations described herein, radial displays present panoramic video from remote locations, or synthesized views of face shots positioned to indicate the viewing direction of remote viewers.

Panoramic portals for connecting remote spaces

Example implementations include a system and method for providing a focus and context view for a movable apparatus. The focus view is indicated in a central portion of the display, and a context view is warped around the focus portion of the display to provide context. In example implementations, selection of another portion to render as the focus portion causes the movable apparatus to orient itself to the focus portion as the forward direction.

System and method for focus and context views for telepresence and robotic teleoperation

Example implementations include a system and method for remotely controlling the motion of a robot. In example implementations, the user is presented with a display having video from a camera on the robot augmented with abstract sensor data, and facilitates the user to draw motion path commands directly on the camera view. Analysis of the scene for obstacles is performed, so that the drawing of commands is interactive, preventing the user from drawing impossible paths. The path sketch is then transformed into the coordinate system of the robot and used to generate commands that will move the robot to the desired location. Sensor data is also used to augment the camera view, in particular for highlighting dangers and obstacles.

System and method for mobile robot teleoperation

A method of creating a 3-D model by capturing partial 3-D models each comprising a sequence of 2-D images, analyzing each of the partial 3-D models to identify image features in the sequence of 2-D images of each of the partial 3-D models, identifying pairs of overlapping image features between the 2-D mages of each of the partial 3-D models by identifying image features in each 2-D image in the sequence of 2-D images of each of the partial 3-D models that overlaps image features in 2-D images of the sequence of 2-D images of the other partial 3-D models and selecting a 2-d image from each of the partial 3-D models, computing an initial transformation between 3-D coordinates of individual pairs of identified image features between the selected 2-D image from each of the partial 3-D models; and generating a final 3-D model based on the initial transformation.

Method for creating 3-D models by stitching multiple partial 3-D models

Systems and methods for repeat photography and difference extraction that help users take pictures from the same position and camera angle as earlier photos. The system automatically extracts differences between the photos. Camera poses are estimated and then indicators are rendered to show the desired camera angle, which guide the user to the same camera angle for repeat photography. Using 3D rendering techniques, photos are virtually projected onto a 3D model to adjust them and improve the match between the photos, and the difference between the two photos are detected and highlighted. Highlighting the detected differences helps users to notice the differences.

Augmented reality navigation for repeat photography and difference extraction

A method and system for defining a model by analyzing images of a physical space. In some embodiments the images of a physical space contain distinctive visual features with associated semantic information, and the model is defined using image feature detection techniques to identify distinctive visual features and a rich marker-based markup language to give meaning to the distinctive visual features. In some embodiments the distinctive visual features are predefined markers, and the markup language specifies model aspects and rules for combining semantic information from a plurality of markers to define the model.

Growing community of inventors

Sunnyvale, CA, United States of America

James Vaughan