Monitoring and optimization of human-device interactions

Abstract

A real time system for monitoring and optimizing patient adherence to digital therapy. The system can measure at least one of head stability, eye stability, gaze direction, head pose, facial expression, reading related eye movements, eye alignment stability, eye blink rate, attentive engagement, general engagement, emotional state, total eye stability, yawning and distance between the user and the camera. This information is provided as input to computer vision algorithms to generate a multi-dimensional representation of user attention and engagement. The system can alert the caregiver or health care professional if the patient disengages from the treatment and if the patient is sitting at the wrong distance from the treatment device. The system includes a camera, a processor, computer vision algorithms executed by the processor (a GPU processor), at least one digital display device, a loud speaker and an optional internet connection that can enable communication with other electronic devices.