Huawei Technologies Co., Limited

Yannick Verdie

Juwei Lu

Gregory Gibran Slabaugh

Ales Leonardis

Deepak Sridhar

Steven George McDonagh

Benjamin Busam

Zi Hao Yang

Axel Barroso Laguna

Matthieu Hog

Patrick Ruhkamp

Zihao Yang

Methods and devices are described for computer vision-based gesture detection. From a frame of image data, extracted locations of keypoints of a detected hand are obtained. The extracted locations are normalized to obtain normalized features. The normalized features are processed using a trained decision tree ensemble to generate a probability of a valid gesture for the detected hand. The generated probability is compared with a defined decision threshold to generate a binary classification to classify the detected hand as a valid gesture or invalid gesture.

Devices and methods for single or multi-user gesture detection using computer vision

Methods and systems for estimation of a 3D hand pose are disclosed. A 2D image containing a detected hand is processed using a U-net network to obtain a global feature vector and a heatmap for the keypoints of the hand. Information from the global feature vector and the heatmap are concatenated to obtain a set of input tokens that are processed using a transformer encoder to obtain a first set of 2D keypoints representing estimated 2D locations of the keypoints in a first view. The first set of 2D keypoints are inputted as a query to a transformer decoder, to obtain a second set of 2D keypoints representing estimated 2D locations of the keypoints in a second view. The first and second sets of 2D keypoints are aggregated to output the set of estimated 3D keypoints.

Methods and systems for 3D hand pose estimation from RGB images

The technology of this application related to an image processor comprising a plurality of modules, the plurality of modules comprising a first module and a second module, wherein the image processor is configured to receive an input image and output a plurality of mathematical descriptors for characteristic regions of the input image. The first module is configured to implement a first trained artificial intelligence model to detect a set of characteristic regions in the input image; and the second module is configured to implement a second trained artificial intelligence model to determine a mathematical descriptor for each of said set of characteristic regions. The first and second trained artificial intelligence models are collectively trained end to end.

Feature detector and descriptor

An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.

Time-of-flight depth enhancement

Growing community of inventors

Toronto, Canada

Yannick Verdie