Matsushita Electric Industrial Co., Ltd.

Storz Endoskop Produktions Gmbh

Karl Storz Imaging, Inc.

Panasonic Corporation

Karl Storz Se Co. & Kg

Storz Endoskop Producktions Gmbh

Matteo Contolini

Jean-Claude Junqua

Roland Kuhn

Ted H Applebaum

Gang Wang

Heinz-Werner Stiller

Chengyi Zheng

Sankaran Panchapagesan

Juri Baumberger

David Chatenever

Robert C Boman

Yi Zhao

Michael Galler

Murat Karaorman

Rathinavelu Chengalvarayan

Timothy Rutland

Ken Field

Methods and systems for controlling a workflow in an operating room including interconnected medical devices that support surgical systems and surgical operations. Methods and systems to control clinical information through the use of a medical device, such that use of a medical device at least partially determines the clinical information that is displayed on a display monitor.

Surgical workflow support system

A system includes a medical device and an authenticator. The medical device has a medical sensor configured to generate patient data indicative of a sensed physiological characteristic of a patient. The authenticator has at least one biometric sensor configured to generate at least one biometric signal indicative of at least one biometric characteristic of a user of the medical device. The authenticator is configured to (i) identify and authenticate a user of the medical device, (ii) protect patient data generated by the medical sensor of the medical device using a user ID unique to the identified user, and (iii) save the protected patient data to a memory.

System and method for identifying and authenticating a user of a medical device, and controlling access to patient data generated by the medical device

A system and method for managing workflow of a medical procedure, including a control and at least one detector such as a sensor, where the control interprets a user input to control the workflow of the medical procedure. The system and method include multiple input modalities and hazard mitigation measures to control the medical procedure and/or control various medical devices in an operating room.

Context-aware user interface for integrated operating room

Methods and systems are provided for pairing a command device to a remotely controlled medical system. A command device is paired to a remotely controlled system, to control one or more medical devices from the command device. Registering the command device is done at a registration component at a designated location in an operating area, with an identifier for the operating area. While registered, the command device is able to transmit commands for controlling the medical equipment. The command device location is repeatedly estimated from its sensors based on markers or beacons in the operating area, to determine if it has left the area. Upon leaving, it is deregistered.

System and method to restrict the operational range of wireless devices

A voice controlled medical system with improved speech recognition includes a first microphone array, a second microphone array, a controller in communication with the first and second microphone arrays, and a medical device operable by the controller. The controller includes a beam module that generates a first beamed signal using signals from the first microphone array and a second beamed signal using signals from the second microphone array. The controller also includes a comparison module that compares the first and second beamed signals and determines a correlation between the first and second beamed signals. The controller also includes a voice interpreting module that identifies commands within the first and second beamed signals if the correlation is above a correlation threshold. The controller also includes an instrument control module that executes the commands to operate said medical device.

Voice control system with multiple microphone arrays

A voice controlled medical system with improved speech recognition includes a microphone in an operating environment and a medical device. The voice controlled medical system further includes a controller in communication with the microphone and the medical device that operates the medical device by executing audio commands received by the microphone. The voice controlled medical system further includes a calibration signal indicative of distortion in the operating environment which is generated by comparing an audio signal played in the operating environment with a sound signal received by the microphone. The controller uses the calibration signal to interpret audio commands received by the microphone.

System and method for calibrating a speech recognition system to an operating environment

A voice controlled surgical system including a wireless command microphone receiving audio input, a voice control module for generating commands from the audio input received by said wireless command microphone, a detection module for generating signals indicative of a proximity of said wireless command microphone, a switch module for disabling the commands in response to one or more of the signals, and an alarm module activated in response to the one or more of the signals.

Wireless command microphone management for voice controlled surgical system

A speech recognition and control system including a receiver for receiving an audio input, an event detector for analyzing the audio input and identifying at least one event of the audio input, a recognizer for interpreting at least a portion of the audio input, a database including a plurality of rules, and a controller for generating a control command based on the at least one event and at least one rule.

System and method for hazard mitigation in voice-driven control applications

The system includes a controller having first and second speech recognition modules and a decision module. The system includes at least one medical device operable by the controller. The system includes a first microphone in communication with the first speech recognition module, and a second microphone in communication with the second speech recognition module. The first speech recognition module generates a first set of commands from voice signals it receives from the first microphone. The second speech recognition module generates a second set of commands from voice signals it receives from the second microphone. The decision module receives the first and second sets of commands, accepts a subset of the commands in the first and second sets, rejects the remainder of the commands, and assembles a third set of commands comprising the accepted commands. The controller executes the third set of commands to operate the at least one medical device.

Multi-user voice control system for medical devices

The system includes a remotely controlled medical system having a controller in communication with a command device incorporating a microphone. The system further includes a medical device operable by the controller and a sound generator coupled to the controller. The command device incorporating a microphone is paired to the controller for operating the medical device by detecting the sound. The command device incorporating a microphone transmits a signal in response to the sound to the controller to verify the pairing of the command device incorporating a microphone to the controller such that the controller will only operate the medical device in response to a command issued near the sound generator.

System and method for pairing a command device incorporating a microphone to a remotely controlled medical system

An audio, visual and device data capturing system including an audio recorder for recording audio data, at least one visual recorder for recording visual data, at least one device data recorder for receiving device data from at least one device in communication with the system, a speech recognition module for interpreting the audio data, a transcript module for generating transcript data from the interpreted audio data, a data capturing module for generating a data record including at least a portion of each of the audio data, the transcript data, the visual data and the device data, and at least one storage device for storing the data record.

Audio, visual and device data capturing system with real-time speech recognition command and control system

A speech recognition and control system including a sound card for receiving speech and converting the speech into digital data, the sound card removably connected to an input of a computer, recognizer software executing on the computer for interpreting at least a portion of the digital data, event detection software executing on the computer for detecting connectivity of the sound card, and command control software executing on the computer for generating a command based on at least one of the digital data and the connectivity of the sound card.

A device control system including at least one device operable by the system, at least one processor, software executing on the at least one processor for receiving message data and determining a corresponding XML document type, software executing on the at least one processor for generating a XML document based on the XML document type, the XML document including the message data, software executing on the processor for packetizing the XML document, and two or more communication components, each communication component including an XML parser for parsing the XML document and extracting the message data.

Device control system employing extensible markup language for defining information resources

A speech recognition and control system continuously operable by two or more users. The system includes a receiver for receiving a speech input, a processor in communication with the receiver and a database in communication with the processor. The database includes user profiles. The system also includes profile management software executing on the processor for determining an active profile from the plurality of user profiles, and software executing on the processor for identifying at least one command from the speech input based on the active profile.

Speech recognition system with user profiles management component

A call routing and supervising system includes an input receiving customer speech from a remote location, and a voice characteristics extractor extracting voice characteristics from the customer speech, such as language/dialect/accent, age group, gender, and eigendimension coordinates. A customer service representative selector selects one or more customer service representatives based on profiles of the customer service representatives respective of customers having voice characteristics similar to the extracted voice characteristics. In other aspects, a call monitor automatically analyzes dialogue between the customer and the customer service representative, such as detected interruptions, tracked dialogue turns, and recognized key phrases indicating frustration, polity, and/or resolution characteristics of dialogue. The call monitor records performance of the customer service representative respective of customers having the voice characteristics. Automatic call rerouting and/or real-time instruction of call center personnel can also be accomplished based on analysis results.

Growing community of inventors

Santa Barbara, CA, United States of America

Matteo Contolini