Sentiar, Inc.

Other

Excera Inc.

Michael K Southworth

Walter M Blume

Jonathan R Silva

Jennifer N Avari Silva

Ignacio Soriano

Christopher Michael Andrews

Sharif Razzaque

Irene Hougard

Alexander Bair Henry

Matthew Dagley

Berk Tas

Walter Blume

In an embodiment, a system receives data from a first electromagnetic sensor coupled to a head-mounted display (HMD) and detecting an electromagnetic field generated by an electromagnetic reference source coupled to an ultrasound probe. The system receives data from a second electromagnetic sensor coupled to a medical instrument and detecting the electromagnetic field. The system determines a position of the HMD relative to the ultrasound probe. The system determines a position of the medical instrument relative to the ultrasound probe. The system generates a visualization of a path of the medical instrument oriented relative to an ultrasound image plane. The system provides a graphic for display by the HMD to a user wearing the HMD, where the graphic includes the visualization and image data captured by the ultrasound probe displayed on the ultrasound image plane.

Multiscale ultrasound tracking and display

A processing system provides two-way communication between an electroanatomic navigation and mapping system (EAMS) and a head-mounted display (HMD). A user wearing the HMD can use hands-free or touch-free actions to interact with a user interface for EAMS information displayed by the HMD (e.g., 3D augmented reality graphics) or by a display monitor (e.g., 2D graphics). For example, the processing system updates the position of a cursor on the display monitor to track a gaze direction of the user as determined by the HMD.

Two-way communication between head-mounted display and electroanatomic system

In an embodiment, a processing system provides an augmented reality object for display by a head-mounted device (HMD) worn by a user. The processing system provides an augmented reality graphic for display by the HMD on a plane and overlaid on the augmented reality object. The processing system determines a gaze direction of the user using sensor data captured by a sensor of the HMD. Responsive to determining that the gaze direction intersects with the augmented reality graphic on the plane and remains intersecting for at least a period of time, the processing system determines a position of intersection between the gaze direction and the augmented reality graphic on the plane. The processing system provides a modified version of the augmented reality object for display by the HMD according to the position of intersection during the period of time.

Gaze based interface for augmented reality environment

In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.

Electrogram annotation system

A visualization system provides graphics for presentation on displays of multiple users who may be wearing head-mounted displays (HMDs). In an embodiment, the system determines that a first gaze direction of a first user is directed toward a first display. The system determines user inputs performed by the first user. The user inputs may be hands-free such as gestures of a hand or finger or voice commands. The system generates a graphical annotation using the user inputs. The system provides the graphical annotation to a first HMD for presentation to the first user. The system determines a second display paired to the first display. The system provides the graphical annotation to a second HMD for presentation to a second user looking at the second display. The displays may include a physical display or a virtual display, for example, in an augmented reality environment.

Augmented reality display sharing

An intercom system provides audio communication between multiple users wearing head-mounted devices (HMDs). In an embodiment, the intercom system determines a first location of a first HMD of a first user. The intercom system determines a second location of a second HMD of a second user. The intercom system receives audio of the first user from a microphone of the first HMD. The intercom system determines a volume level of the audio at the second location using at least the first location and the second location. The intercom system transmits the audio to the second HMD responsive to determining that the volume level is less than a threshold volume. The intercom system may also selectively transmit audio based on gaze direction of a user. Additionally, the intercom system may generate a transcript of audio input by users.

Intercom system for multiple users

A sticker system includes at least a head-mounted device and a sticker. In an embodiment, the sticker system receives an image of the sticker captured by an imaging sensor. The sticker system determines registration information by processing a fiducial marker of the sticker shown in the image. The sticker system determines location information of the HMD. Additionally, the sticker system determines a position of the sticker relative to the HMD using the registration information and the location information. The sticker system provides a (e.g., augmented reality) graphic to the HMD for presentation to the user based on the position of the sticker.

Growing community of inventors

St. Louis, MO, United States of America

Michael K Southworth