Fyusion, Inc.

Luke Parham

Stefan Johannes Josef Holzer

Radu Bogdan Rusu

Pantelis Kalogiros

Stephen David Miller

Martin Markus Hubert Wawro

Keith Martin

Mike Penz

Julius Santiago

Dave Morrison

Jai Chaudhry

Bojana Dumeljic

Abhishek Kar

Ioannis Spanos

Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of an object can be generated from live images of an object captured from a camera. After the MVIDMR of the object is generated, a tag can be placed at a location on the object in the MVIDMR. The locations of the tag in the frames of the MVIDMR can vary from frame to frame as the view of the object changes. When the tag is selected, media content can be output which shows details of the object at location where the tag is placed. In one embodiment, the object can be car and tags can be used to link to media content showing details of the car at the locations where the tags are placed.

Visual annotation using tagging sessions

Provided are mechanisms and processes for performing live search using multi-view digital media representations. In one example, a process includes receiving a visual search query from a device for an object to be searched, where the visual search query includes a first set of viewpoints of the object obtained during capture of a first surround view of the object during a live search session. Next, additional recommended viewpoints of the object are identified for the device to capture, where the additional recommended viewpoints are chosen to provide more information about the object. A first set of search results based on the first set of viewpoints and additional recommended viewpoints of the object are transmitted to the device. In response, a second set of viewpoints of the object captured using image capture capabilities of the device are received. A second set of search results with enhanced matches for the object based on the first and second sets of viewpoints are then transmitted to the device. This process may continue iteratively until a desired set of search results is obtained.

Client-server communication for live search using multi-view digital media representations

Growing community of inventors

San Francisco, CA, United States of America

Luke Parham