A9.com, Inc.

Amazon Technologies, Inc.

Arnab Sanat Kumar Dhua

Yu Lou

Xiaofan Lin

Sunil Ramesh

Himanshu Arora

Douglas Ryan Gray

Colin Jon Taylor

David Creighton Mott

Radek Grzeszczuk

Adam Wiggen Kraft

Kathy Wing Lam Ma

Scott Paul Robertson

Ming Du

Xi Zhang

Gurumurthy D Ramkumar

William Brendel

Karl Hillesland

Aishwarya Natesh

Nityananda Jayadevaprakash

Atul Kumar

Chun-Kai Wang

Simant Dube

Gautam Bhargava

Nalin Senthamil

Chetan Pitambar Bhole

Bryan E Feldman

Erick Cantu-Paz

Tomas Francisco Yago Vicente

Zhijiang Mark Lu

Radek Grzeszcsuk

Sudeshna Pantham

Jaishanker K Pillai

Eran Borenstein

Xing Zhang

Ismet Zeki Yalniz

Michael Patrick Cutter

Anish Ramdas Nair

Jared Corso

Jesse Chang

Jason Freund

Neil Raj Kumar

Leo Benedict Baldwin

William Alexander Strand

Isabella Talley Lewis

Raghavan Manmatha

Mehmet Nejat Tek

R Manmatha

Paulo Ricardo Dos Santos Mendonca

Max Delgadillo

Yifan Xing

Max Delgadillo, Jr

Sonja E Hyde-Moyer

Ketan Ramesh Deshpande

Chen Fang

Yuting Wang

Dheeraj Soti

Maya Kabkab

Colin Jay Taylor

A computing device can obtain data describing at least one document, the at least one document referencing at least one media object, wherein a portion of the at least one media object includes one or more characters. The computing device can obtain data describing the one or more characters in the at least one media object in the at least one document. The computing device can generate an updated copy of the at least one document that includes the data describing the one or more characters in the at least one media object. The computing device can present, on a display screen of the computing device and through an interface, the updated copy of the at least one document, wherein the one or more characters in the at least one media object are able to be selected or searched.

Media processing techniques for enhancing content

Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Rendering three-dimensional models on mobile devices

Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object. The representation can be manipulated on the client device in an augmented reality setting.

Photorealistic three dimensional texturing using canonical views and a two-stage approach

Various embodiments enable a computing device to perform tasks such as processing an image to recognize text or an object in an image to identify a particular product or related products associated with the text or object. In response to recognizing the text or the object as being associated with a product available for purchase from an electronic marketplace, one or more advertisements or product listings associated with the product can be displayed to the user. Accordingly, additional information for the associated product can be displayed, enabling the user to learn more about and purchase the product from the electronic marketplace through the portable computing device.

Augmented reality recommendations

Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Optically challenging surface detection for augmented reality

Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Compression of multi-dimensional object representations

Various embodiments enable an image recognition system reduce the number image match candidates before running a full-fledged pair-wise match on all image match candidates. In order to accomplish this, each inventory image can be assigned to a group. For example, a title for a book sold by an electronic marketplace could be available in multiple languages, in multiple bindings, and the book could be available in print, audio book, or electronic book. Each one of these variations could be associated with its own similarly looking inventory image, each of which could be returned as a valid match to a query image for the book. Accordingly, the inventory images for these variations could be assigned to a group for the book and, instead of geometrically processing an image for each variation, the image match system can process a single image representing all of the variations.

Image recognition result culling

Approaches herein provide for multi-camera calibration and subsequent application in augmented reality applications. The approach obtains image data of a three-dimensional (3D) calibration object from different directions using the at least one camera. A determination is made for extrinsic parameters associated with a relative position of the 3D calibration object to the at least one camera. A further determination is made for intrinsic parameters associated with the at least one camera relative to the 3D calibration object facing in the different positions. Revised intrinsic parameters are generated from the intrinsic parameters. The revised intrinsic parameters provide a calibration output that may be applied to generate views of an item in an augmented reality application.

Camera calibration for augmented reality

Various embodiments provide methods and systems for users and business owners to share content and/or links to visual elements of a place at a physical location, and, in response to a user device pointing at a tagged place, causing the content and/or links to the visual elements of the place to be presented on the user device. In some embodiments, content and links are tied to specific objects at a place based at least in part upon one of Global Positioning System (GPS) locations, Inertial Measurement Unit (IMU) orientations, compass data, or one or more visual matching algorithms. Once the content and links are attached to the specific objects of the place, they can be discovered by a user with a portable device pointing at the specific objects in the real world.

Sharing links in an augmented reality environment

Systems and methods for displaying 3D containers in a computer generated environment are described. A computing device may provide a user with a catalog of objects which may be purchased. In order to view what an object may look like prior to purchasing the object, a computing device may show a 3D container that has the same dimensions as the object. As discussed herein, the 3D container may be located and oriented based on a two-dimensional marker. Moreover, some 3D containers may contain a representation of an object, which may be a 2D image of the object.

Augmented reality product preview

Growing community of inventors

Mountain View, CA, United States of America

Arnab Sanat Kumar Dhua