Jd.com American Technologies Corporation

Beijing Jingdong Shangke Information Technology Co., Ltd.

Beijing Wodong Tianjun Information Technology Co., Ltd.

Jingdong Technology Holding Co., Ltd.

Jingdong Digits Technology Holding Co., Ltd.

Jd Finance America Corporation

Guanghan Ning

Harry Huang

Chi Zhang

Xiaochuan Fan

Hui Zhou

Si Luo

Shizhu Liu

Liefeng Bo

Min Li

Xiaofan Zhang

Jui-Hsin Lai

Ping Liu

A system and a method for object detection using augmented training dataset. The system includes a computing device, which is configured to: provide a two-dimensional (2D) image, extract feature vectors and estimate depths of 2D image pixels, generate a point cloud using the feature vectors and the depths, and project the point cloud using a new camera pose to obtain a projected image. The 2D image has a bounding box enclosing an object and labeled with the object. Each pixel within the bounding box is named bounding box pixel, each point in the point cloud corresponding to the bounding box pixel is named bounding box point, each image pixel in the projected image corresponding to the bounding box point is named projected bounding box pixel, and a projected bounding box is defined using the projected bounding box pixels and labeled with the object.

Data augmentation for object detection via differential neural rendering

A system for knowledge graph construction. The system includes a computing device. The computing device has a processor and a storage device storing computer executable code. The computer executable code, when executed at the processor, is configured to: define entities and relations of the knowledge graph; provide documents having sentences; convert the sentences into fix length sentence embeddings and regard the sentence embeddings as primary capsule layers; use a set transformer to learn entity capsules and relation capsules from the primary capsule layers; for each triple, project head and tail entities from entity space to the specific relation space, and determine the relation exists when the sum of the projected head entity vector and the relation vector substantially equals to the projected tail entity vector; and construct the knowledge graph using the head entity, the tail entity, and the determined relation.

System and method for knowledge graph construction using capsule neural network

A method, a device, and a non-transitory computer readable medium for item recommendation based on visual elements. The method includes: determining, by one or more processors, visual elements from an item image of an item; generating, by the one or more processors, an element descriptor for the item based on at least a part of the visual elements; and calculating, by the one or more processors, a compatibility value between the element descriptor and one or more other element descriptors for one or more other items.

Device and method for item recommendation based on visual elements

A system and a method for cooperative maneuvering and cooperative risk warning of vehicles. The system includes monocular surveillance cameras, local computing devices, and a master server. Each local computing device receives video frames from the camera, detects and tracks vehicles from the video frames, and converts the video frames to bird-view. Each detected vehicle is represented by a detection vector having first dimensions representing two dimensional (2D) parameters of the vehicle and second dimensions representing three dimensional (3D) parameters of the vehicle. Tracking of the vehicles is performed by minimizing loss calculated based on the first dimensions and the second dimensions of the detection vectors. The master server receives bird-views from different computing devices and combines the bird-views into a global bird-view, and performs cooperative maneuvering and cooperative risk warning of the vehicles using the global bird-view.

System and method for 3D object detection and tracking with monocular surveillance cameras

A system and a method for pose tracking, particularly for top-down, online, multi-person pose tracking. The system includes a computing device having a processor and a storage device storing computer executable code. The computer executable code, when executed at the processor, is configured to: provide a plurality of sequential frames of a video, the sequential frames comprising at least one keyframe and a plurality of non-keyframes; for each of the non-keyframes: receive a previous inference bounding box of an object inferred from a previous frame; estimate keypoints from the non-keyframe in an area defined by the previous inference bounding box to obtain estimated keypoints; determine object state based on the estimated keypoints, wherein the object state comprise a 'tracked' state and a 'lost' state; and when the object state is &#x201c;tracked,&#x201d; infer an inference bounding box based on the estimated keypoints to process a frame next to the non-keyframe.

Lighttrack: system and method for online top-down human pose tracking

A method, a device and a non-transitory computer readable medium for tracking poses of multiple objects. The method includes detecting, by a processor, objects from each of a plurality of consecutive frames in a video sequence; estimating, by the processor, a pose of each of the objects within each of the plurality of consecutive frames; and tracking, by the processor, the poses of each of the objects across the plurality of consecutive frames.

Device and method of tracking poses of multiple objects based on single-object pose estimator

Growing community of inventors

Sunnyvale, CA, United States of America

Guanghan Ning