Microsoft Technology Licensing, LLC

Kun Luo

Zicheng Liu

Yinpeng Chen

Lijuan Wang

Kevin Shude Lin

Ying Jin

Hongli Deng

Pei Qun Yu

Pei Yu

A method for environment-specific training of a machine learning model, comprises receiving, for a local environment, a data stream including a plurality of sequential data snippets. Programmed labels are generated for each data snippet using a student version of a machine learning model. A portion of data snippets and associated programmed labels are selected and uploaded to a server-side computing device for evaluation by a teacher version of the machine learning model. An environment-specific training update is received from the server-side computing device. This training update is based on a comparison of the selected programmed labels and pseudolabels generated for the selected portion of data snippets by the teacher version. The environment-specific training update is applied to the student version to generate an updated student version. The updated student version of the machine learning model is then used to generate programmed labels for newly received data snippets.

Environment-specific training of machine learning models

To improve the accuracy and efficiency of object detection through computer digital image analysis, the detection of some objects can inform the sub-portion of the digital image to which subsequent computer digital image analysis is directed to detect other objects. In such a manner object detection can be made more efficient by limiting the image area of a digital image that is analyzed. Such efficiencies can represent both computational efficiencies and communicational efficiencies arising due to the smaller quantity of digital image data that is analyzed. Additionally, the detection of some objects can render the detection of other objects more accurate by adjusting confidence thresholds based on the detection of those related objects. Relationships between objects can be utilized to inform both the image area on which subsequent object detection is performed and the confidence level of such subsequent object detection.

Focused computer detection of objects in images

A computing system is provided. The computing system includes a processor configured to execute a convolutional neural network that has been trained, the convolutional neural network including a backbone network that is a concatenated pyramid network, a plurality of first head neural networks, and a plurality of second head neural networks. At the backbone network, the processor is configured to receive an input image as input and output feature maps extracted from the input image. The processor is configured to: process the feature maps using each of the first head neural networks to output corresponding keypoint heatmaps; process the feature maps using each of the second head neural networks to output corresponding part affinity field heatmaps; link the keypoints into one or more instances of virtual skeletons using the part affinity fields; and output the instances of the virtual skeletons.

Neural network for skeletons from input images

Growing community of inventors

Redmond, WA, United States of America

Kun Luo