Fyusion, Inc.

Matteo Munaro

Stefan Johannes Josef Holzer

Radu Bogdan Rusu

Pavel Hanchar

Abhishek Kar

Krunal Ketan Chande

Alexander Jay Bruen Trevor

Aidas Liaudanskas

Martin Markus Hubert Wawro

Martin Saelzle

Rodrigo Ortiz-Cayon

Nico Gregor Sebastian Blodow

Pantelis Kalogiros

Mike Penz

Matthias Reso

Santi Arano

Stephen David Miller

Chris Beall

Milos Vlaski

Yusuke Tomoto

Luo Yi Tan

Wook Yeon Hwang

Johan Nordin

Nick Stetco

Rodrigo Ortiz Cayon

Julius Santiago

Ioannis Spanos

Michelle Jung-Ah Ho

Jai Chaudhry

Srinivas Rao

Raul Dronca

Ashley Wakefield

Josh Faust

Santiago Arano Perez

Tanvir Parhar

Blake McConnell

Nishant Rai

A plurality of images of an object and a background may be captured. Three-dimensional representations of the background and the object may be generated based on the captured images. A synthetic image of the object and the background may be rendered. The synthetic image may depict a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images. A corrected synthetic image may be generated. The corrected synthetic image may be stored on a storage medium.

Automatically generating synthetic images from novel viewpoints

Provided are mechanisms and processes for scene-aware selection of filters and effects for visual digital media content. In one example, a digital media item is analyzed with a processor to identify one or more characteristics associated with the digital media item, where the characteristics include a physical object represented in the digital media item. Based on the identified characteristics, a digital media modification is selected from a plurality of digital media modifications for application to the digital media item. The digital media modification may then be provided for presentation in a user interface for selection by a user.

Scene-aware selection of filters and effects for visual digital media content

A background scenery portion may be identified in each of a plurality of image sets of an object, where each image set includes images captured simultaneously from different cameras. A correspondence between the image sets may determined, where the correspondence tracks control points associated with the object and present in multiple images. A multi-view interactive digital media representation of the object that is navigable in one or more dimensions and that includes the image sets may be generated and stored.

Mobile multi-camera multi-view capture

One or more two-dimensional images of a three-dimensional object may be analyzed to estimate a three-dimensional mesh representing the object and a mapping of the two-dimensional images to the three-dimensional mesh. Initially, a correspondence may be determined between the images and a UV representation of a three-dimensional template mesh by training a neural network. Then, the three-dimensional template mesh may be deformed to determine the representation of the object. The process may involve a reprojection loss cycle in which points from the images are mapped onto the UV representation, then onto the three-dimensional template mesh, and then back onto the two-dimensional images.

Weak multi-view supervision for surface mapping estimation

A live camera feed may be analyzed to determine the identify of an object, and augmented reality overlay data may be determined based on that identity. The overlay data may include one or more tags that are each associated with a respective location on the object. The live camera feed may be presented on a display screen with the tags being positioned as the respective location.

Live in-camera overlays

Images of an object may be captured via a camera at a mobile computing device at different viewpoints. The images may be used to identify components of the object and to identify damage estimates estimating damage to some or all of the components. Capture coverage levels corresponding with the components may be determined, and then recording guidance may be provided for capturing additional images to increase the capture coverage levels.

Multi-view visual data damage detection

Images of an object may be captured at a computing device. Each of the images may be captured from a respective viewpoint based on image capture configuration information identifying one or more parameter values. A multiview image digital media representation of the object may be generated that includes some or all of the images of the object and that is navigable in one or more dimensions.

Damage detection from multi-view visual data

Damage to an object such as a vehicle may be detected and presented based at least in part on image data. In some configurations, image data may be detected by causing the object to pass through a gate or portal on which cameras are located. Alternatively, or additionally, image data may be selected by a user operating a camera and moving around the object. The cameras may capture image data, which may be combined and analyzed to detect damage. Some or all of the image data and/or analysis of the image data may be presented in a viewer, which may allow a user to perform actions such as navigating around the object in a virtual environment, identifying and viewing areas of the object where damage has been detected, and accessing the results of the analysis.

Multi-view interactive digital media representation viewer

Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.

Enclosed multi-view visual media representation

Images of an undercarriage of a vehicle may be captured via one or more cameras. A point cloud may be determined based on the images. The point cloud may includes points positioned in a virtual three-dimensional space. A stitched image may be determined based on the point cloud by projecting the point cloud onto a virtual camera view. The stitched image may be stored on a storage device.

Vehicle undercarriage imaging

The pose of an object may be estimated based on fiducial points identified in a visual representation of the object. Each fiducial point may correspond with a component of the object, and may be associated with a first location in an image of the object and a second location in a 3D coordinate pace. A 3D skeleton of the object may be determined by connecting the locations in the 3D space, and the object's pose may be determined based on the 3D skeleton.

Object pose estimation in visual data

Mappings are determined between viewpoints of an object and an object model representing the object. Each mapping identifies a location on the object model corresponding with a portion of the object captured in one of the viewpoints. Tags for the object model are created based on the mappings, where each tag links one of the viewpoints to one of the locations on the object model. A user interface that includes the object model and the tags is provided for presentation on a display screen in a user interface. One of the viewpoints is presented in the user interface when the corresponding tag is selected in the object model.

Structuring visual data

A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.

Growing community of inventors

San Francisco, CA, United States of America

Matteo Munaro