Intuitive Surgical Operations, Inc.

Siemens Healthcare Gmbh

Nvidia Corporation

Siemens Aktiengesellschaft

Mahdi Azizian

Jonathan Michael Sorger

Pourya Shirazian

Simon P Dimaio

Daniel Proksch

A Jonathan McLeod

Brian David Hoffman

William C Nowlin

Holger Kunze

Lutz Blohm

Ian E McDowall

Anthony Michael Jarc

Henry C Lin

Christine Niebler

Brent Tokarchuk

Andrew Cullen Waterbury

Azad Shademan

Maximilian Hunter Allan

Amy E Kerdok

Margaret M Nixon

Joey Chau

Christopher R Burns

Douglas S Langley

Liron Leist

John D Seaman, Ii

Wesley Swanson

Boris Foelsch

Paul W Mohr

Simon Peter DiMaio

Oliver J Wagner

May Quo-Mei Liu

Wen Pei Liu

Brandon D Itkowitz

Alan S Bradley

Angus Jonathan Mcleod

Sean Huver

Thomas Kierski

Johnathan M Sorger

Ian E Mcdowall

John D Ii Seaman

Karen C Brandao

An exemplary image management system accesses semantic information regarding an anatomical object in a surgical space and registers, based at least in part on the semantic information regarding the anatomical object, a first dataset of a first visual representation of the surgical space with a second dataset of a second visual representation of the surgical space.

Systems and methods for registering visual representations of a surgical space

A method comprises obtaining an endoscopic image dataset of a patient anatomy from an endoscopic imaging system and retrieving an anatomic model dataset of the patient anatomy obtained by an anatomic imaging system. The method also comprises mapping the endoscopic image dataset to the anatomic model dataset and displaying a first vantage point image using the mapped endoscopic image dataset. The first vantage point image is presented from a first vantage point at a distal end of the endoscopic imaging system. The method also comprises displaying a second vantage point image using at least a portion of the mapped endoscopic image dataset. The second vantage point image is presented from a second vantage point, different from the first vantage point.

Systems and methods for projecting an endoscopic image to a three-dimensional volume

A movable table may be configured to support a patient. The movable table may comprise a communication interface configured to communicatively couple with a medical device. The movable table may also comprise one or more processors and a non-transitory machine-readable medium comprising a plurality of instructions which, when executed by the one or more processors, cause the one or more processors to perform operations. The operations may include transmitting, via the communication interface and to the medical device, information relating to a planned motion of the movable table and receiving, via the communication interface and from the medical device, a response to the information relating to the planned motion of the movable table. Based on the response received from the medical device, the operations may include selectively causing performance of the planned motion of the movable table.

System and method for coordinated motion among heterogeneous devices

A method is provided to model a 3D structure comprising: producing a surface mesh representation of the 3D structure; producing a volume mesh representation of the 3D structure based upon the surface mesh; sorting vertices of the volume mesh into a first sub-list that includes only surface vertices and a second sub-list that includes only internal vertices; applying shading to the surface mesh by accessing only surface vertices in the first sub-list; determining deformation of the volume mesh by accessing both surface vertices in the first sub-list and internal vertices in the second sub-list.

Unified anisotropic volume and surface mesh storage

A teleoperated surgical system is provided comprising: a first robotic surgical instrument; an image capture; a user display; a user input command device coupled to receive user input commands to control movement of the first robotic surgical instrument; and a movement controller coupled to scale a rate of movement of the first robotic surgical instrument, based at least in part upon a surgical skill level at using the first robotic surgical instrument of the user providing the received user input commands, from a rate of movement indicated by the user input commands received at the user input command device.

Teleoperated surgical system with surgeon skill level based instrument control

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Configuring surgical system with surgical procedures atlas

A system and method of specular reflection detection and reduction includes a processing unit including one or more processors and an imaging unit coupled to the processing unit. The imaging unit includes one or more first illuminators for providing illumination of a region of interest, one or more first detectors for detecting reflections of the illumination, one or more second illuminators for triggering fluorescing of one or more fluorescent materials in the region of interest, and one or more second detectors for detecting the fluorescing of the fluorescent materials. The processing unit is configured to receive a first image from the first detectors, determine one or more regions of high specular reflection in the first image, mask out the regions of high specular reflection in the first image, and generate a composite image based on the masked first image and the detected fluorescence. The first image includes the detected reflections.

System and method for specular reflection detection and reduction

A device pairing system is configured to determine that an auxiliary device detects an ultrasonic beacon emitted by a beacon generator and identify, in response to the determination that the auxiliary device detects the ultrasonic beacon, a medical system associated with the ultrasonic beacon. The auxiliary device is further configured to communicatively pair, in response to the identification of the medical system, the auxiliary device with the identified medical system.

Beacon-based systems and methods for communicatively pairing a device with a medical system

An exemplary contextual assistance system identifies, during a surgical procedure, an operational context of the surgical procedure while a particular object is present at a surgical site depicted by a first version of an image. Based on the identified operational context, the contextual assistance system augments a depiction of the particular object within a second version of the image that is presented to a user associated with the surgical procedure. Corresponding systems and methods are also disclosed.

Systems and methods for providing surgical assistance based on operational context

A surgical robotic system may comprise a manipulator assembly including a manipulator arm having a distal portion. The surgical robotic system may also comprise a registration device mounted to a surgical table. The table mounted registration device includes a registration element shaped to contact with the distal portion of the manipulator arm by receiving the distal portion of the manipulator arm to define a spatial relationship between the manipulator assembly and the table mounted registration device. The distal portion of the manipulator arm moves in a plurality of degrees of freedom. The plurality of degrees of freedom is reduced by the table mounted registration device when the table mounted registration device is in contact with the distal portion of the manipulator arm. The surgical robotic system may also comprise a control system that determines the spatial relationship between the manipulator assembly and the table mounted registration device.

Methods and devices for tele-surgical table registration

An exemplary system is configured to instruct a display device to render a virtual medical element representative of a physical medical element over a target region within an image of an internal space of a patient, the target region depicting an anatomical surface to be covered by the physical medical element; receive, while the virtual medical element is rendered over the target region, user input that sets at least one of a pose of the virtual medical element within the image or a size of the virtual medical element; and determine, based on the user input and on depth data representative of a depth map for the internal space, physical dimensions for the physical medical element.

Physical medical element sizing systems and methods

A medical system includes one or more processors. The processors are configured to perform operations including receiving image data associated with an anatomic feature from a first imaging device. The image data is associated with a first imaging device space. Probe data associated with the anatomic feature is obtained from a second imaging device. The probe data is associated with a second imaging device space. The probe data is registered to the image data to generate a first registration between the second imaging device space and the first imaging device space. Anatomic model associated with the anatomic feature is registered to the probe data to generate a second registration between a model space of the anatomic model and the second imaging device space. A third registration between the model space and the first imaging device space is generated based on the first registration and the second registration.

System and method related to registration for a medical procedure

An exemplary object masking system is configured to mask a recognized object during an application of a synthetic element to an original image. For example, the object masking system accesses a model of a recognized object depicted in an original image of a scene. The object masking system associates the model with the recognized object. The object masking system then generates presentation data for use by a presentation system to present an augmented version of the original image in which a synthetic element added to the original image is, based on the model as associated with the recognized object, prevented from occluding at least a portion of the recognized object. In this way, the synthetic element is made to appear as if located behind the recognized object. Corresponding systems and methods are also disclosed.

Systems and methods for masking a recognized object during an application of a synthetic element to an original image

An illustrative system may be configured to obtain a visual image of an anatomical scene that includes an imaging probe and to augment the visual image with a synthetic element that indicates, within the visual image, an area of the anatomical scene being imaged by the imaging probe. The synthetic element may include spatial markers. The visualization system may be further configured to direct a display device to display the augmented image. The visualization system may be further configured to direct the display device to display, at a position outside of the synthetic element, a probe image captured by the imaging probe.

Anatomical scene visualization systems and methods

A contact detection system is configured to classify each pixel in a plurality of pixels included in an ultrasound image captured by an ultrasound probe located within a patient as either showing tissue or showing non-tissue; determine an average pixel classification representative of a number of pixels classified as showing tissue compared to a number of pixels classified as showing non-tissue; determine, if the average pixel classification is above a first contact state threshold, that the ultrasound probe is in a first contact state that indicates that the ultrasound probe is in operative physical contact with the tissue; and determine, if the average pixel classification is below a second contact state threshold lower than the first contact state threshold, that the ultrasound probe is in a second contact state that indicates that the ultrasound probe is not in operative physical contact with the tissue.

Systems and methods for detecting tissue contact by an ultrasound probe

Growing community of inventors

Santa Clara, CA, United States of America

Mahdi Azizian