Method of providing a digitally represented visual instruction from a specialist to a user in need of said visual instruction, and a system therefor

Abstract

The present invention provides a method of providing a digitally represented visual instruction from a specialist () operating a visual instruction device () to a user () in need of the visual instruction in relation to an object of interest () and a system therefore. In the method a first video stream comprising images of the object of interest is recorded by a first mobile device () associated with the user. The first video stream is sent () to a second mobile device () associated with the specialist. A second video stream comprising the visual instruction device is recorded by the second mobile device and a foreground/background segmentation operation and a background replacement operation is performed on the second and first video stream to provide a third video stream comprising images of the visual instruction device with the first video stream as background. The third video stream is sent () to the first mobile device and is displayed essentially simultaneously on first and second displays on both mobile devices allowing the user, by viewing the first display, to be instructed by the specialist and the specialist, by viewing the second display, to operate the visual instruction device properly in relation to the object of interest. An alternative method using a projection device in the first mobile device and systems corresponding to the methods are also provided.