Intuitive Surgical Operations, Inc.

A Jonathan McLeod

Mahdi Azizian

Pourya Shirazian

Daniel Proksch

Azad Shademan

Maximilian Hunter Allan

Christopher R Burns

Alan S Bradley

Wen Pei Liu

Liron Leist

Boris Foelsch

An exemplary image management system accesses semantic information regarding an anatomical object in a surgical space and registers, based at least in part on the semantic information regarding the anatomical object, a first dataset of a first visual representation of the surgical space with a second dataset of a second visual representation of the surgical space.

Systems and methods for registering visual representations of a surgical space

A device pairing system is configured to determine that an auxiliary device detects an ultrasonic beacon emitted by a beacon generator and identify, in response to the determination that the auxiliary device detects the ultrasonic beacon, a medical system associated with the ultrasonic beacon. The auxiliary device is further configured to communicatively pair, in response to the identification of the medical system, the auxiliary device with the identified medical system.

Beacon-based systems and methods for communicatively pairing a device with a medical system

An exemplary contextual assistance system identifies, during a surgical procedure, an operational context of the surgical procedure while a particular object is present at a surgical site depicted by a first version of an image. Based on the identified operational context, the contextual assistance system augments a depiction of the particular object within a second version of the image that is presented to a user associated with the surgical procedure. Corresponding systems and methods are also disclosed.

Systems and methods for providing surgical assistance based on operational context

An exemplary object masking system is configured to mask a recognized object during an application of a synthetic element to an original image. For example, the object masking system accesses a model of a recognized object depicted in an original image of a scene. The object masking system associates the model with the recognized object. The object masking system then generates presentation data for use by a presentation system to present an augmented version of the original image in which a synthetic element added to the original image is, based on the model as associated with the recognized object, prevented from occluding at least a portion of the recognized object. In this way, the synthetic element is made to appear as if located behind the recognized object. Corresponding systems and methods are also disclosed.

Systems and methods for masking a recognized object during an application of a synthetic element to an original image

A contact detection system is configured to classify each pixel in a plurality of pixels included in an ultrasound image captured by an ultrasound probe located within a patient as either showing tissue or showing non-tissue; determine an average pixel classification representative of a number of pixels classified as showing tissue compared to a number of pixels classified as showing non-tissue; determine, if the average pixel classification is above a first contact state threshold, that the ultrasound probe is in a first contact state that indicates that the ultrasound probe is in operative physical contact with the tissue; and determine, if the average pixel classification is below a second contact state threshold lower than the first contact state threshold, that the ultrasound probe is in a second contact state that indicates that the ultrasound probe is not in operative physical contact with the tissue.

Systems and methods for detecting tissue contact by an ultrasound probe

An exemplary image registration system identifies a subsurface structure at a surgical site based on subsurface imaging data from a subsurface image scan at the surgical site. The image registration system uses the identified subsurface structure at the surgical site for a registration of endoscopic imaging data from an endoscopic imaging modality with additional imaging data from an additional imaging modality. Corresponding systems and methods are also disclosed.

Systems and methods for identifying differentiated blood vessels and registering imaging data from different imaging modalities based on subsurface image scanning

An exemplary tissue volume detection system accesses, during a surgical procedure involving resecting a piece of tissue from a body, a plurality of depth datasets for the resected piece of tissue. Each of the plurality of depth datasets is captured as a different portion of a surface of the resected piece of tissue is presented to an imaging device by an instrument that holds the resected piece of tissue in a manner that sequentially presents the different portions of the surface to the imaging device. During the surgical procedure and based on the depth datasets, the system generates a three-dimensional (3D) occupancy map that includes a set of voxels identified to be occupied by the resected piece of tissue. Based on the 3D occupancy map and still during the surgical procedure, the system determines an estimated volume of the resected piece of tissue. Corresponding systems and methods are also disclosed.

Systems and methods for determining a volume of resected tissue during a surgical procedure

A composite medical imaging system may direct a display device to display an image captured by an imaging device and showing a view of a surgical area and display an augmentation region within the image and that shows supplemental content. The view of the surgical area shows surface anatomy located at the surgical area and an object located at the surgical area. The augmentation region creates an occlusion over at least a portion of the view of the surgical area. The system may detect an overlap in the image between at least a portion of the object and at least a portion of the augmentation region. In response to the detection of the overlap, the system may adjust the image to decrease an extent of the occlusion within the overlap by the augmentation region.

Composite medical imaging systems and methods

An exemplary system accesses imagery of a surgical space captured by different imaging modalities and, based on the accessed imagery, generates composite imagery that includes integrated representations of the surgical space as captured by the different imaging modalities. An exemplary composite image includes a representation of the surgical space as captured by a first imaging modality augmented with an integrated representation of the surgical space as captured by a second imaging modality. The integrated representation of the surgical space as captured by the second imaging modality may be selectively movable and may be generated based on first imagery of the surgical space captured by the first imaging modality and second imagery of the surgical space captured by the second imaging modality in a manner that provides a visually realistic appearance of depth.

Growing community of inventors

Sunnyvale, CA, United States of America

A Jonathan McLeod