Intuitive Surgical Operations, Inc.

Anthony Michael Jarc

Henry C Lin

Jonathan Michael Sorger

Simon P Dimaio

Joey Chau

Ian E McDowall

Brian David Hoffman

William C Nowlin

Mahdi Azizian

Brent Tokarchuk

Brandon D Itkowitz

Govinda Payyavula

Brian Edward Miller

Chi Zhang

John William Henrie

John D Seaman, Ii

Christopher J Sanchez

Timothy V White

Eugene T Nagel

Simon Peter DiMaio

May Quo-Mei Liu

Kiran Bhattacharyya

Aneeq Zia

Amy E Kerdok

Julie L Berry

Liheng Guo

Sue Kulason

Linlin Zhou

Kristen Brown

Ian E Mcdowall

John D Ii Seaman

A system includes a sensor to sense a change in a position of an input control component and a tool; a storage medium embodies a collection of respective motion pictures, which show tool movement imparted by the control component in response to manual input provided by users, indexed based upon a metric; a storage medium embodies a set of instructions that cause a processor to perform operations comprising: determining a user's performance; recording a motion picture of the tool movement imparted by the master control component by the individual user; indexing the recorded motion picture to the collection of motion pictures; generating a user interface providing an interactive visual index; and displaying a selected motion picture on the display screen in response to user input at the interactive visual index.

Training users using indexed to motion pictures

Various of the disclosed embodiments are directed to computer-implemented systems and methods for recognizing surgical tasks from surgical data, In some embodiments an ensemble model configured to receive video data, kinematics data, and system event data from the surgical theater may be implemented. The ensemble model may implement modular streams for processing the data, facilitating predictions even when less than all the data types are available. In some embodiments, smoothing operations may help facilitate more accurate prediction results, Various of the embodiments may be employed in real-time during surgery, providing predictions at per-second intervals.

Systems and methods for surgical data classification

A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator's head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.

Systems and methods for entering and exiting a teleoperational state

Implementations relate to medical simulations for medical procedure training. In some implementations, a system includes a simulation processing component including at least one processor and which generates a virtual environment using position signals that describe at least one of a position and a configuration of a physical surgical instrument relative to a physical surgical site. The simulation processing component updates the virtual environment according to changes in the position signals and according to control signals corresponding to inputs by a user of the system. The updating includes moving a virtual surgical instrument within the virtual environment, where an interaction of the virtual surgical instrument with a virtual surgical site is defined at least partly by a physical relationship between the physical surgical instrument and the physical surgical site. The simulation processing component outputs a representation of a simulation state signal indicative of a current state of the virtual environment.

Simulator system for medical procedure training

Various of the disclosed embodiments relate to computer systems and computer-implemented methods for measuring and monitoring surgical performance, For example, the system may receive raw data acquired from the surgical theater, generate and select features from the data amenable to analysis, and then train a machine learning classifier using the selected features to facilitate subsequent assessment of other surgeons' performances. Generation and selection of the features may itself involve application of a machine learning classifier in some embodiments. While some embodiments contemplate raw data acquired from surgical robotic systems, some embodiments facilitate assessments upon data acquired from non-robotic surgical theaters.

Systems and methods for assessing surgical ability

A teleoperated surgical system is provided comprising: a first robotic surgical instrument; an image capture; a user display; a user input command device coupled to receive user input commands to control movement of the first robotic surgical instrument; and a movement controller coupled to scale a rate of movement of the first robotic surgical instrument, based at least in part upon a surgical skill level at using the first robotic surgical instrument of the user providing the received user input commands, from a rate of movement indicated by the user input commands received at the user input command device.

Teleoperated surgical system with surgeon skill level based instrument control

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Configuring surgical system with surgical procedures atlas

A medical system comprises an eye tracking unit which includes an image display, an eye tracker, and a processor. The image display is configured to display to a user an image of a surgical field. The eye tracker is configured to measure data corresponding to eye gaze dynamics of the user during a procedure. The processor configured to assess a stress or fatigue level of the user based on the measured data. A corresponding method includes displaying an image of a surgical field on an image display, measuring a gaze point of a user during a procedure with an eye tracker, measuring data corresponding to eye gaze dynamics of the user during the procedure, and assessing a stress or fatigue level of the user based on the measured data.

Medical devices, systems, and methods using eye gaze tracking

A camera control system may access surgical session data for a surgical session, the surgical session including performance of one or more operations by a computer-assisted surgical system. The camera control system may identify, based on the surgical session data, an event associated with the surgical session, and may determine, based on the surgical session data, a location associated with the event. In response to the determination of the location of the event, the camera control system may direct an automatic adjustment of a view of a camera to capture a specific view of the location associated with the event.

Camera control systems and methods for a computer-assisted surgical system

A viewpoint optimization system identifies a condition associated with an operating session during which a computer-assisted operation system performs a plurality of operations with respect to a body while an imaging device included within the computer-assisted operation system provides, for display on a display device during the operating session, imagery of the body from a first viewpoint. The viewpoint optimization system defines, based on the identified condition, a second viewpoint for the imaging device that is more optimal than the first viewpoint for an operation included in the plurality of operations. Additionally, the viewpoint optimization system directs the display device to display an indication of the second viewpoint. Corresponding systems and methods are also disclosed.

Systems and methods for facilitating optimization of an imaging device viewpoint during an operating session of a computer-assisted operation system

Systems, methods, and tangibly-implemented software instructions for supporting a teleoperated surgical system (TSS). A surgical input that includes monitored events of the TSS, is received. A current stage of the surgical procedure is autonomously determined based on the surgical input. A call for surgeon assistance may be detected, in response to which context-relevant assistance may be provided to a surgeon console of the TSS, the context-relevant assistance being stage-synchronized with the surgical procedure.

Surgical system with training or assist functions

A mechanically ungrounded master control device comprises a rigid chassis for engagement with one or more fingers of a user's hand and at least one pivotable finger engagement device for controlling movement of a tool end effector. The control device also includes at least one sensor for detecting a position and orientation of the rigid chassis in a surgical environment and a switch coupled to the rigid chassis and manipulatable by a finger of the user's hand while another finger of the user's hand is engaged with the at least one pivotable finger engagement device.

Ungrounded master control devices and methods of use

A teleoperational medical system includes a teleoperational control system, a teleoperational manipulator configured for operating a medical instrument in a medical environment, and an operator controller. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether a head portion of an operator of the operator controller is directed toward or away from a display region of a display device based on at least one marker on the operator that is configured to remain substantially fixed relative to the head portion of the operator during a movement of the head portion. The processing unit is further configured to, based on a determination that the head portion is directed away from the display region for at least a threshold time period, enter a standby mode such that movement of the operator controller does not provide corresponding movement to the teleoperational manipulator.

Growing community of inventors

Duluth, GA, United States of America

Anthony Michael Jarc