Interactive endoscopy for intraoperative virtual annotation in vats and minimally invasive surgery

Abstract

A controller () for live annotation of interventional imagery includes a memory () that stores software instructions and a processor () that executes the software instructions. When executed by the processor (), the software instructions cause the controller () to implement a process that includes receiving (S) interventional imagery during an intraoperative intervention and automatically analyzing (S) the interventional imagery for detectable features. The process executed when the processor () executes the software instructions also includes detecting (S) a detectable feature and determining (S) at add an annotation to the interventional imagery for the detectable feature. The processor further includes identifying (S) a location for the annotation as an identified location in the interventional imagery and adding (S) the annotation to the interventional imagery at the identified location to correspond to the detectable feature. During the intraoperative intervention, a video is output (S) as video output based on interventional imagery and the annotation, including the annotation overlaid on the interventional imagery at the identified location.