Cilag International Gmbh

Verb Surgical Inc.

Risto Kojcev

Frederick E Shelton, IV

Cory G Kimball

Matthew D Cowperthwait

Leonardo N Rossoni

Felix J Bork

Monica L Z Rivard

Shane R Adams

Kevin Michael Fiebig

Bernhard A Fuerst

Jason L Harris

Pablo E Garcia Kilroy

Berk Gonenc

Christopher Q Seow

Jacqueline C Aronhalt

Benjamin Sanker

Matjaz Jogan

Felix Bork

Taylor W Aronhalt

Zhifan F Huang

Nicholas J Ross

Chad E Eckert

John E Brady

Tylor C Muhlenkamp

Joshua P Morgan

Brendan J Oberkircher

Eric Mark Johnson

Austin E Wise

Demetrius N Harris

Scott A Jenkins

Ellen E Burkart

Tyler N Brehm

Ryan W McGhee

Madison K Vanosdoll

Grace E Brooks

Alexander Barthel

Shaun B Schaeffer

Melissa Schweizer

Matthew J Thiel

Monica Lz Rivard

Monica LZ Rivard

Iv Frederick E Shelton

A method of assessing inter-device communication pairing in a surgical setting, may include transmitting, by a first intelligent medical device, wireless communication data within the surgical setting, receiving, by a second intelligent medical device, the wireless communication data from the first intelligent medical device, determining, by the second intelligent medical device, communication pairing data indicative of an inter-device communication pairing of the second intelligent medical device with the first intelligent medical device, transmitting, by the second intelligent medical device, the communication pairing data to a modular control tower, and displaying, by the modular control tower on a display device, an augmented reality display comprising one or more virtual objects indicative of the inter-device communication pairing. An interactive surgical system may include multiple intelligent medical devices and displays which can form communication pairs in this manner.

Indication of the couple pair of remote controls with remote devices functions

A system, method, and device for displaying relevant augmented reality (AR) content to a surgical staff members without over-saturating the augmented display with virtual elements. The surgical staff members (e.g., doctors, nurses, surgeons, technicians, etc.) require AR content that is delicately balanced between displaying helpful information without distracting the surgeon. A surgical hub receives a plurality of inputs related to surgical environment and displays only necessary information to allow the surgeon to provide effective care to the patient, based on a determined trigger event.

Utilizing contextual parameters of one or more surgical devices to predict a frequency interval for displaying surgical information

A surgical system is for use in a surgical procedure. The surgical system includes a surgical instrument configured to treat tissue in the surgical procedure; an imaging device; a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and a control module. The control module is configured to detect a surgical risk; assign a display priority to the surgical risk; and determine a display arrangement of the surgical risk based on the display priority, wherein the display arrangement comprises overlaying an alert feature on the livestream.

Risk based prioritization of display aspects in surgical field view

A surgical system is disclosed including an imaging device, a display, and a control system operably coupled to the imaging device and the display. The display is configured to show a livestream of a surgical field of a surgical procedure. The livestream is captured by the imaging device. The control system is configured to overlay, on the livestream, a first amount of information associated with the surgical procedure, detect an event configured to cause the first amount of information being overlaid to increase to a second amount of information being overlaid, compare the second amount of information to a distraction threshold, adjust the second amount of information to a third amount of information based on the comparison, and overlay, on the livestream, the third amount of information based on the second amount of information being adjusted. The third amount of information is less than the distraction threshold.

Systems and methods for controlling surgical data overlay

Errors in a blended stream that would result in non-display or obscuring of a live video stream from a medical device may be automatically detected, and a failover stream corresponding to the first live video stream may be displayed to medical personnel. For example, one or more second input streams that are being blended may contain no data or invalid data which may result in the blended stream not displaying (or obscuring) the live video stream (if the blended were displayed). Switching from blending to a failover buffer may occur within the time to process a single video image frame. Upon detection (prior to display) that the blended stream would not display the live video stream, display of the live video stream from the failover buffer may be initiated. Other aspects are also described and claimed.

Apparatus, systems, and methods for intraoperative visualization

A method of distributing data among members of a surgical team may include receiving imaging data, by a modular control tower, from a plurality of imaging devices, receiving device-dependent data, by the modular control tower, from each of a plurality of intelligent surgical instruments, associating, by the modular control tower, a display device with a member of the surgical team, defining, by the modular control tower, a functional role for the member of the surgical team, and displaying, by the modular control tower, a augmented reality display by the display device. The augmented reality display on the display device may include virtual objects based on the imaging data, the device-dependent data, the functional role of the member of the surgical team, and a surgical activity by the member of the surgical team. An interactive surgical system may implement this method.

Customization of overlaid data and configuration

An augmented reality display system and method for use during a surgical procedure are disclosed. An imaging device captures a real image of a surgical area during the surgical procedure generates a first data feed. A sensor device generates a second data feed. An augmented reality device including an augmented reality display generates an augmented overlay based on the first and second data feeds. The augmented overlay includes a visual portion and a non-visual visual portion. A processor receives the first and second data feeds and combines the first and second data feeds to generate the augmented overlay.

Mixed reality feedback systems that cooperate to increase efficient perception of complex data feeds

Apparatuses, systems, and methods for displaying a cooperative overlays based on interacting instruments are disclosed herein. In one aspect, a method for displaying cooperative overlays includes communicatively coupling a first augmented reality display device to a surgical hub; generating, by the first augmented reality display device, a first intraoperative display of a surgical field; displaying, by the first intraoperative display, a first data overlay based on operation of a first surgical instrument; interacting the first surgical instrument with a second surgical instrument; and displaying, by the first intraoperative display, an indicator of the interaction based on the interaction between the first and second surgical instruments.

Cooperative overlays of interacting instruments which result in both overlays being effected

A medical image viewer can render to a display, a three-dimensional view of patient anatomy, a multi planar reconstruction (MPR) view of the patient anatomy, and an intra-operational view. Some of the views can be synchronized to show a common focal point of the anatomy. Other embodiments are described and claimed.

Three dimensional medical imaging and interactions

Growing community of inventors

Santa Clara, CA, United States of America

Risto Kojcev