Intuitive Surgical Operations, Inc.

Fakespace Labs, Inc.

Fakespace, Inc.

Mosi Media, LLC

Im Networks, Inc.

Other

University of Southern California

Kitagawa Industries Co., Inc.

Sonicbox, Inc.

Ian E McDowall

Mark T Bolas

Jeffrey M DiCarlo

Brian David Hoffman

John Ryan Steger

Daniel H Gomez

Christopher J Hasser

Wenyi Zhao

Jonathan Michael Sorger

Ryan Charles Abbott

Amy E Kerdok

Stephen J Blumenkranz

Gregory William Dachs, Ii

Theodore W Rogers

William C Nowlin

Mahdi Azizian

Govinda Payyavula

Arthur Louis Berman

Anthony Michael Jarc

Henry C Lin

William Jason Culman

Russell C Mead, Jr

Brent Tokarchuk

Catherine J Mohr

Simon P Dimaio

Jason Paul Watson

John D Stern

Joey Chau

John D Seaman, Ii

Bruce M Schena

Brandon D Itkowitz

Paul W Mohr

David D Scott

Randal P Goldberg

Patrick O'Grady

Max J Trejo

Scott Smith

Alexander L Antaris

Tao Zhao

Andrew J Hazelton

Simon Peter DiMaio

Paul E Lilagan

David C Shafer

Thomas R Nixon

Paul E Debevec

Niels Smaby

John A Barton

Jonathan D Halderman

Heath Feather

Yu-Min Lee

Derek C Liou

Kierstin Gray Parrish

David J Frerichs

J Adam Jones

Alexandre V Matveev

May Quo-Mei Liu

Marc Levesque

Jeffrey M Dicarlo

Evan Suma

Doris Lin

Andrew Jones

Mary McCann

Christian Greuel

Russell Mead

Michael N Bolas

Technology described herein can be embodied in a method that includes obtaining, using an imaging device, a plurality of images of a surgical scene, each image in the plurality of images being obtained under illumination by electromagnetic radiation in one of a plurality of wavelength ranges. The plurality of wavelength ranges are at least partially non-overlapping. The method also includes identifying a set of pixel values across multiple images in the plurality of images, wherein each pixel value in the set of pixel values is substantially representative of a particular portion of the surgical scene and determining, based on the set of pixel values and a chromophore model, a concentration of a chromophore in the particular portion of the surgical scene, wherein the chromophore model represents relationships between combinations of pixel values and chromophore concentrations.

Determining chromophore concentrations in tissues

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Configuring surgical system with surgical procedures atlas

An exemplary fluorescence imaging control system may direct, during a surgical procedure performed with a computer-assisted surgical system, an illumination source included in the computer-assisted surgical system to illuminate a scene associated with the surgical procedure with fluorescence excitation illumination configured to excite a fluorophore present at the scene and direct an imaging device included in the computer-assisted surgical system to detect, during the surgical procedure, fluorescence emitted by the fluorophore in response to excitation of the fluorophore by the fluorescence excitation illumination. The fluorescence imaging control system may determine, based on the detected fluorescence, a lifetime of the fluorescence and determine, based on the determined lifetime of the fluorescence, an identity of the fluorophore. The fluorescence imaging control system may configure, during the surgical procedure and based on the determined identity of the fluorophore, operation of the computer-assisted surgical system.

Systems and a method for directing an imaging device to detect fluorescence and for determining a lifetime of the fluorescence

In some embodiments, a controller of a computer-assisted surgical system receives a visible image captured by an image capture unit of a surgical system, receives a plurality of hyperspectral images captured at a same waveband by the image capture unit of the surgical system, generates a composite hyperspectral image from the plurality of hyperspectral images, and spatially registering the composite hyperspectral image with the visible image.

Simultaneous white light and hyperspectral light imaging systems

A computer-assisted medical system includes robotic manipulators, a user input system operable to generate signals to control the manipulators, and a controller configured to execute instructions to perform operations. A portion of the user input system is movable relative to the plurality of manipulators. The operations include, in a pairing mode, associating a first manipulator of the plurality of manipulators with the portion of the user input system based on movement of the portion of the user input system relative to the first manipulator, and, in a following mode, controlling motion of the first manipulator in accordance with an indication generated by the user input system in response to operation of the portion of the user input system by a user.

Association processes and related systems for manipulators

A computer-assisted medical system includes manipulators, a user input system, a user output system comprising a display device, and a controller configured to execute instructions to perform operations. The operations include, in a pairing mode and in response to a first set of signals generated by the user input system, causing a virtual selector shown on the display device to move relative to an imagery shown on the display device. The operations further include, in the pairing mode, associating a first manipulator with a portion of the user input system based on movement of the virtual selector relative to a represented location of the first instrument, and, in a following mode, controlling motion of the first instrument in accordance to a second set of signals generated by the user input system in response to operation of the portion of the user input system by a user.

Technology described herein can be embodied in a method of displaying a visual representation of a portion of a surgical scene. The method includes receiving data representing information captured using a first sensor of a camera associated with a surgical device, the information being indicative of a first quantity representing an amount of fluorescence emitted from the portion of the surgical scene. The method also includes obtaining information indicative of a second quantity representing an amount of excitation signal causing the fluorescence to be emitted from the portion of the surgical scene, and generating a normalized fluorescence signal as a function of the first quantity and the second quantity. The method further includes generating the visual representation of the portion of the surgical scene based on the normalized fluorescence signal, and presenting the visual representation on a display device associated with the surgical device.

Illumination corrected near-infrared (nir) imaging for image guided surgery

An example method includes causing an illuminator to simultaneously illuminate tissue with a first visible color illumination component, a second visible color illumination component, and a fluorescence excitation illumination component; and causing a display unit to display, based on the illumination, a display scene that includes: a reduced color scene component corresponding to the first and second visible color illumination components, and a highlighted scene component corresponding to the fluorescence excitation illumination component.

Multi-function imaging

A system for identifying a location of a lumen of a tubular body structure in a patient's body includes a flexible, longitudinally extending probe configured to be inserted through the lumen in the tubular body structure in the patient. A detection system may include an antenna arranged to receive signals from a longitudinally extending detectable portion of the probe. A processing system may process the received signals and identify a longitudinally extending position of the longitudinally extending detectable portion of the probe in a three dimensional reference frame.

Tubular body structure imaging and locating system

An illustrative method may include receiving images of a site captured at a same time by a camera, the images comprising a single visible color component image, a first non-visible image associated with first excitation illumination having a first wavelength outside a visible spectrum, and a second non-visible image associated with second excitation illumination having a second wavelength outside the visible spectrum and different than the first wavelength; generating, based on the single visible color component image, a monochromatic image; generating, based on the single visible color component image and the first non-visible image, a first alternate image representative of a first alternate imaging characteristic of the site; generating, based on the single visible color component image and the second non-visible image, a second alternate image representative of a second alternate imaging characteristic of the site; and displaying the monochromatic image combined with the first and second alternate images.

Methods and systems for alternate image display

A stereoscopic endoscope comprises at least one image sensor for sensing a first image and a second image of a pair of stereo images. The first image is sensed based on light passing through a first aperture within the stereoscopic endoscope. The second image is sensed based on light passing through a second aperture within the stereoscopic endoscope. The stereoscopic endoscope further comprises a liquid crystal layer disposed between two layers of glass. The two layers of glass comprise a first arrangement of electrodes, such that each of the first aperture and the second aperture is created in the liquid crystal layer using a portion of the first arrangement of electrodes. A polarization state associated with each of the first and second apertures are controlled using corresponding control signals provided through the first arrangement of electrodes.

Dynamic aperture positioning for stereo endoscopic cameras

A system directs an imaging device to continuously capture visible light and fluorescence illumination from a surgical area. The system generates a visible light image stream based on the captured visible light and a fluorescence image stream based on the captured fluorescence illumination. The system operates in a first display mode by directing a display device to display a first video stream based on a first set of at least one of the visible light image stream and the fluorescence image stream. In response to detecting an event that occurs within the surgical area, the system switches from operating in the first display mode to operating in a second display mode by directing the display device to display a second video stream based on a second set of at least one of the visible light image stream and the fluorescence image stream, the first Instructions set being different than the second set.

Augmented medical vision systems and methods

Systems and methods for minimally invasive computer-assisted telesurgery are described. A computer-assisted teleoperated surgery system includes a teleoperated instrument actuation pod. The surgical instrument actuation pod includes a plurality of linear actuators arranged around a surgical instrument. The linear actuators engage with actuator engagement members on the instrument and so drive movable parts on the instrument. The actuation pod is mounted on a teleoperated manipulator. Instrument pod mass is close to the teleoperated manipulator to minimize the pod's inertia, momentum, and gravity effects on the manipulator.

Computer-assisted tele-operated surgery systems and methods

An image capture unit has mounted in a frame: a first imaging assembly, a first circuit board, a second imaging assembly, and a second circuit board. The first imaging assembly is mounted on the first circuit board. The second imaging assembly is mounted on the second circuit board. A portion of the first circuit board and a portion of the second circuit board have a stacked configuration with the portion of the first circuit board being approximately parallel to the portion of the second circuit board. An end of another portion of the first circuit board is adjacent to an end of another portion of the second circuit board.

Compact stereoscopic image capture unit

Systems and methods for image detection during grasping and stapling include an end effector having a first jaw and a second jaw, an imaging sensor mounted to the end effector and configured to capture images of a material graspable by the end effector, and one or more processors coupled to the end effector and the imaging sensor. The one or more processors are configured to receive the images from the imaging sensor, determine one or more properties of the material based on the images, and display the one or more properties of the material on an interface. In some embodiments, the end effector is part of a medical tool and the material is anatomical tissue. In some embodiments, the end effector further includes one or more of a stapling mechanism configured to staple the material or a cutting mechanism configured to cut the material.

System and method for image detection during instrument grasping and stapling

Growing community of inventors

Woodside, CA, United States of America

Ian E McDowall