A9.com, Inc.

Chun-Kai Wang

Yu Lou

Arnab Sanat Kumar Dhua

Colin Jon Taylor

Himanshu Arora

David Creighton Mott

Xi Zhang

Sudeshna Pantham

Radek Grzeszczuk

Rahul Bhotika

Mark Scott Waldo

Ismet Zeki Yalniz

Michael Patrick Cutter

Paulo Ricardo Dos Santos Mendonca

Yifan Xing

Daniya Zamalieva

Song Cao

Approaches herein provide for multi-camera calibration and subsequent application in augmented reality applications. The approach obtains image data of a three-dimensional (3D) calibration object from different directions using the at least one camera. A determination is made for extrinsic parameters associated with a relative position of the 3D calibration object to the at least one camera. A further determination is made for intrinsic parameters associated with the at least one camera relative to the 3D calibration object facing in the different positions. Revised intrinsic parameters are generated from the intrinsic parameters. The revised intrinsic parameters provide a calibration output that may be applied to generate views of an item in an augmented reality application.

Camera calibration for augmented reality

Systems and methods for displaying 3D containers in a computer generated environment are described. A computing device may provide a user with a catalog of objects which may be purchased. In order to view what an object may look like prior to purchasing the object, a computing device may show a 3D container that has the same dimensions as the object. As discussed herein, the 3D container may be located and oriented based on a two-dimensional marker. Moreover, some 3D containers may contain a representation of an object, which may be a 2D image of the object.

Augmented reality product preview

Various algorithms are presented that enable an image of a data matrix to be analyzed and decoded for use in obtaining information about an object or item associated with the data matrix. The algorithms can account for variations in position and/or alignment of the data matrix. In one approach, the image is analyzed to determine a connected region of pixels. The connected region of pixels can be analyzed to determine a pair of pixels, included in the connected region of pixels, that is separated a greatest distance wherein a first pixel and second pixel of the pair of pixels is associated with image coordinates. Using the image coordinates of the pair of pixels, a potential area of the image that includes the visual code can be determined and the potential area can be analyzed to verify the presence of a potential data matrix.

Decoding visual codes

An auxiliary device can be used to display a fiducial that contains information useful in determining the physical size of the fiducial as displayed on the auxiliary device. A primary device can capture image data including a representation of the fiducial. The scale and orientation of the fiducial can be determined, such that a graphical overlay can be generated of an item of interest that corresponds to that scale and orientation. The overlay can then be displayed along with the captured image data, in order to provide an augmented reality experience wherein the image displayed on the primary device represents a scale-appropriate view of the item in a location of interest corresponding to the location of the auxiliary device. As the primary device is moved and the viewpoint of the camera changes, changes in relative scale and orientation to the fiducial are determined and the overlay is updated accordingly.

Auxiliary device as augmented reality platform

Growing community of inventors

Mountain View, CA, United States of America

Chun-Kai Wang