Intuitive Surgical Operations, Inc.

Govinda Payyavula

Simon P Dimaio

Brandon D Itkowitz

Ian E McDowall

John Ryan Steger

Daniel H Gomez

Brian Edward Miller

Anthony Michael Jarc

Peter M Herzlinger

John William Henrie

Simon Peter DiMaio

Joey Chau

Mark Earl Froggatt

David W Robinson

Huan L Phan

Xingchi He

Terrence B McKenna, Iii

Cortney Jansen

Ian E Mcdowall

Simon Peter Dimaio

Huan Lac Phan

A coordination system for coordinating remote assistance of a medical system involves a support agent executed by a computer processor. The support agent is configured to receive a first support request submitted by a user of the medical system, and identify a support person to respond to the first support request from a multitude of support persons by applying a support person identification logic to a system-internal context. The system-internal context is obtained from a system awareness engine configured to detect information about the medical system. The support agent is further configured to facilitate contact of the support person.

Method and system for coordinating user assistance

A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator's head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.

Systems and methods for entering and exiting a teleoperational state

A computer-assisted medical system includes a user device wearable by an operator. The user device includes a display device configured to present imagery overlaid in an environment of a manipulator assembly, and a sensor configured to detect one or more landmarks in the environment. The medical system includes a controller configured to execute instructions to perform operations The operations include receiving, from the sensor, position or orientation information for the one or more landmarks in the environment, and directing a manual movement of a portion of the manipulator assembly by causing the display device to present the imagery overlaid in the environment based on the received position or orientation information.

Methods of guiding manual movement of medical systems

A system includes a tool, an input device, a shape sensor system, and a processing unit. The processing unit is configured to determine a state estimate of the input device based on shape information from the shape sensor system, and control the tool based on the state estimate.

Systems and methods for controlling a robotic manipulator or associated tool

A computer-assisted medical system includes robotic manipulators, a user input system operable to generate signals to control the manipulators, and a controller configured to execute instructions to perform operations. A portion of the user input system is movable relative to the plurality of manipulators. The operations include, in a pairing mode, associating a first manipulator of the plurality of manipulators with the portion of the user input system based on movement of the portion of the user input system relative to the first manipulator, and, in a following mode, controlling motion of the first manipulator in accordance with an indication generated by the user input system in response to operation of the portion of the user input system by a user.

Association processes and related systems for manipulators

A computer-assisted medical system includes manipulators, a user input system, a user output system comprising a display device, and a controller configured to execute instructions to perform operations. The operations include, in a pairing mode and in response to a first set of signals generated by the user input system, causing a virtual selector shown on the display device to move relative to an imagery shown on the display device. The operations further include, in the pairing mode, associating a first manipulator with a portion of the user input system based on movement of the virtual selector relative to a represented location of the first instrument, and, in a following mode, controlling motion of the first instrument in accordance to a second set of signals generated by the user input system in response to operation of the portion of the user input system by a user.

A camera control system may access surgical session data for a surgical session, the surgical session including performance of one or more operations by a computer-assisted surgical system. The camera control system may identify, based on the surgical session data, an event associated with the surgical session, and may determine, based on the surgical session data, a location associated with the event. In response to the determination of the location of the event, the camera control system may direct an automatic adjustment of a view of a camera to capture a specific view of the location associated with the event.

Camera control systems and methods for a computer-assisted surgical system

A region-based augmentation system is configured to determine that a viewpoint of a user of a display device is directed within an anchor region of a physical world containing the user. In response, the system directs the display device to present augmented content in an evident manner. The evident manner comprises anchoring the augmented content relative to the viewpoint, such that the augmented content follows the viewpoint as the user moves the viewpoint within the anchor region. The system further determines that the viewpoint is directed outside of the anchor region by the user. In response, the system directs the display device to present the augmented content in a less evident manner. The presenting of the augmented content in the less evident manner comprises presenting the augmented content less visibly than the evident manner and/or unanchoring the augmented content relative to the viewpoint. Corresponding methods and systems are also disclosed.

Systems and methods for region-based presentation of augmented content

A mixed reality presentation system identifies an operating condition associated with an operation performed on a body while an active imaging device captures imagery of an internal view of the body. The mixed reality presentation system also determines, based on the identified operating condition, that a display device is to toggle a display of a shape overlay that is displayed together with an external view of the body and that is indicative of an extent of a field of view of the active imaging device relative to the body. Based on the determining that the display device is to toggle the display of the shape overlay, the mixed reality presentation system directs the display device to toggle the display of the shape overlay. Corresponding systems and methods are also disclosed.

Mixed reality systems and methods for indicating an extent of a field of view of an imaging device

A teleoperational medical system includes a teleoperational control system, a teleoperational manipulator configured for operating a medical instrument in a medical environment, and an operator controller. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether a head portion of an operator of the operator controller is directed toward or away from a display region of a display device based on at least one marker on the operator that is configured to remain substantially fixed relative to the head portion of the operator during a movement of the head portion. The processing unit is further configured to, based on a determination that the head portion is directed away from the display region for at least a threshold time period, enter a standby mode such that movement of the operator controller does not provide corresponding movement to the teleoperational manipulator.

An endoscope system comprises an endoscope and a display to display image content captured by the endoscope. The endoscope system also comprises one or more sensors located in a headrest and configured to detect an input at the headrest. The endoscope system also comprises a control module configured to receive one or more sensor signals from the one or more sensors. The one or more sensor signals indicate movement of the headrest with respect to a support on which the headrest is mounted or pressure applied to the headrest. The control module is also configured to adjust the image content displayed by the display in response to the one or more sensor signals.

Endoscope control system

A method for performing a surgical procedure includes adjusting an encoding configuration of a video encoder in response to receiving an input associated with a change of state of a surgical system performing the surgical procedure, and encoding image data of the surgical procedure captured after the change of state based on the adjusted encoding configuration.

Methods and systems for optimizing video streaming

A teleoperational medical system includes a teleoperational control system, a teleoperational manipulator, an operator controller. The control system includes a processing unit configured to: determine a position and orientation of a marker on an operator of the operator controller; determine whether a head portion of the operator is directed toward or away from a display region of a display; based on a determination that the head portion is directed toward the display region, initiate an operator following mode in which a movement of the operator controller provides a corresponding movement to the teleoperational manipulator; and based on a determination that the head portion is directed away, suspend the operator following mode. The determination that the head portion is directed away from the display region of the display device includes determining whether the head portion of the operator is directed away from the display region for a threshold time period.

Growing community of inventors

Fremont, CA, United States of America

Govinda Payyavula