Microsoft Technology Licensing, LLC

Novartis Ag

Jonas Dorn

Peter Kontschieder

Darko Zikic

Antonio Criminisi

Antonio Criminsi

Frank Kurt Dahlke

Video processing for motor task analysis is described. In various examples, a video of a person carrying out a motor task, such as placing the forefinger on the nose, is input to a trained machine learning system to classify the motor task into one of a plurality of classes. In an example, motion descriptors such as optical flow are computed from pairs of frames of the video and the motion descriptors are input to the machine learning system. The motor task analysis may be used to assess or evaluate neurological conditions such as multiple sclerosis and/or Parkinson's.

Motor task analysis system and method

Video processing for motor task analysis is described. In various examples, a video of at least part of a person or animal carrying out a motor task, such as placing the forefinger on the nose, is input to a trained machine learning system to classify the motor task into one of a plurality of classes. In an example, motion descriptors such as optical flow are computed from pairs of frames of the video and the motion descriptors are input to the machine learning system. For example, during training the machine learning system identifies time-dependent and/or location-dependent acceleration or velocity features which discriminate between the classes of the motor task. In examples, the trained machine learning system computes, from the motion descriptors, the location dependent acceleration or velocity features which it has learned as being good discriminators. In various examples, a feature is computed using sub-volumes of the video.

Video processing for motor task analysis

Growing community of inventors

Basel, Switzerland

Jonas Dorn