Computationally adaptive occlusion aware hand landmark estimation

Abstract

A method performed by an electronic device for estimating a landmark point of a body part of subject by electronic device is provided. The method includes generating, by the electronic device, an initial coarse estimation of the landmark point of the body part using a light-weight deep neural network, determining, by the electronic device, an occluded region of the body part based on the generated initial coarse estimation of the landmark point using a segmentation mask, estimating, by the electronic device, the occlusion probability for the landmark point in the at least one occluded region and the generated initial coarse estimation, determining, by the electronic device, a correction factor for applying on the generated initial coarse estimation as a measure of the estimated occlusion probability, and selecting, by the electronic device, a pre-defined number of neural networks by applying the determined correction factor for processing the at least one occluded region and the generated initial coarse estimation to generate final estimation of the landmark point.