Privacy-preserving human action recognition, storage, and retrieval via joint edge and cloud computing

Abstract

The present disclosure provides a method and system for efficiently and securely managing human motion data. In one aspect, a human-motion-data-managing system first receives a sequence of video images including a first person. Next, for each image in the sequence of video images, the human-motion-data-managing system detects the first person in the video image; and subsequently extracts a skeleton figure of the detected first person from the image, wherein the skeleton figure is composed of a set of human keypoints. Next, human-motion-data-managing system combines a sequence of extracted skeleton figures of the detected first person from the sequence of video images to form a skeleton sequence of the detected first person which depicts a continuous motion of the first person. The human-motion-data-managing system subsequently transmits the skeleton sequence to a server in place of the actual images of the first person to preserve the privacy of the first person.