Beijing Jingdong Shangke Information Technology Co., Ltd.

Jd.com American Technologies Corporation

Jingdong Digits Technology Holding Co., Ltd.

Jd Finance America Corporation

Lei Yi

Yue Zhang

Liefeng Bo

Xinyao Wang

Longyin Wen

Wenbo Liu

Chao Pan

A system and a method for obtaining a photo-realistic video from a text. The method includes: providing the text and an image of a talking person; synthesizing a speech audio from the text; extracting an acoustic feature from the speech audio by an acoustic feature extractor; and generating the photo-realistic video from the acoustic feature and the image by a video generation neural network. The video generating neural network is pre-trained by: providing a training video and a training image; extracting a training acoustic feature from training audio of the training video by the acoustic feature extractor; generating video frames from the training image and the training acoustic feature by the video generation neural network; and comparing the generated video frames with ground truth video frames using generative adversarial network (GAN). The ground truth video frames correspond to the training video frames.

System and method for synthesizing photo-realistic video of a speech

A method and a system for self-checkout. The system includes a scanner, an imaging device, and a computing device. The computing device is configured to: initiate a self-checkout event; instruct the imaging device to capture video frames of a region of interest (ROI); track the product; record scanning status and location status of the product; in response to receive a scanning signal from the scanner, record scanning status of the product as scanned; calculate a shoplifting risk score based on a number of the product having the scanning status of unscanned and disappears from the table region or ROI; and provide a shoplifting warning when the shoplifting score is large.

System and method for anti-shoplifting in self-checkout

Growing community of inventors

Fremont, CA, United States of America

Lei Yi