Beijing Wodong Tianjun Information Technology Co., Ltd.

Jd.com American Technologies Corporation

Beijing Jingdong Shangke Information Technology Co., Ltd.

Xiaochuan Fan

Chi Zhang

Guanghan Ning

Yun Xiao

Hui Zhou

Yong Yang

Shizhu Liu

Min Li

Dan Miao

Chumeng Lyu

Shiliang Diao

Ping Liu

Lingfei Wu

Xincheng Wang

Yue Shang

Yunjiang Jiang

Xueying Zhang

A method for recommending a product, includes: providing product information having a product description, a main image, and a plurality of alternate images; for each alternate image: performing saliency segmentation to obtain a segment and a background, defining a segment bounding box enclosing the segment, extracting image feature from the segment bounding box, extracting textual feature from the product description, extracting main image feature from the main image, matching the image feature of the segment bounding box to the textual feature and the main image feature, and determining the alternate image as a qualified alternate image if the image feature of the segment bounding box matches the textual feature and the main image feature; and when a number of the qualified alternate image equals to or is greater than a threshold number, recommending the product to customers.

System and method for validating product photography

A computer-implemented method for searching a product corresponding to a query from a customer. The method includes: embedding the query to obtain a query embedding; retrieving product information having a product text and a product image; embedding the product text to obtain a product text embedding, embedding the product image to obtain a product image embedding, and combining the product text embedding and the product image embedding to obtain a product embedding, where the product image embedding has a same format as the product text embedding; subjecting the query embedding and the product embedding to a transformer to determine whether the query and the product are relevant; and providing the product as a search result of the query when the query and the product are relevant.

System and method for product search by embedding visual representation into text sequences

A method and a system for garment try-on. The method includes: capturing a three dimensional (3D) image of a customer; obtaining first 3D pose of the customer in the 3D image; performing a machine learning model on the 3D pose to generate a first skinned multi-person linear model (SMPL) pose; calculating an angle of the whole body rotation of the customer based on the first SMPL pose; when the angle is in a predefined range relative to a front direction of the customer: constructing an SMPL model using the first SMPL pose; and when the angle is out of the predefined range: generating a second SMPL pose using two dimensional (2D) component of the 3D image, and constructing the SMPL model using the second SMPL pose.

System and method for 3D try-on based on human pose and body shape estimation

A system for knowledge graph construction. The system includes a computing device. The computing device has a processor and a storage device storing computer executable code. The computer executable code, when executed at the processor, is configured to: define entities and relations of the knowledge graph; provide documents having sentences; convert the sentences into fix length sentence embeddings and regard the sentence embeddings as primary capsule layers; use a set transformer to learn entity capsules and relation capsules from the primary capsule layers; for each triple, project head and tail entities from entity space to the specific relation space, and determine the relation exists when the sum of the projected head entity vector and the relation vector substantially equals to the projected tail entity vector; and construct the knowledge graph using the head entity, the tail entity, and the determined relation.

System and method for knowledge graph construction using capsule neural network

A method, a device and a non-transitory computer readable medium for tracking poses of multiple objects. The method includes detecting, by a processor, objects from each of a plurality of consecutive frames in a video sequence; estimating, by the processor, a pose of each of the objects within each of the plurality of consecutive frames; and tracking, by the processor, the poses of each of the objects across the plurality of consecutive frames.

Device and method of tracking poses of multiple objects based on single-object pose estimator

Growing community of inventors

Mountain View, CA, United States of America

Xiaochuan Fan