Magic Leap, Inc.

Han Sen Medical, Inc.

Circuit Therapeutics, Inc.

Auris Health, Inc.

Koninklijke Philips Corporation N.V.

David Charles Lundmark

Daniel T Wallace

Frederic H Moll

Samuel A Miller

Gunter D Niemeyer

Robert G Younge

Kenneth M Martin

David F Moore

Daniel Thomas Adams

Gregory J Stahler

Michael R Zinn

Alexander K Arrow

Fred Moll

Brian Everett Meaney

Michael Janusz Woods

Shivakumar Balasubramanyam

Marc Coleman Shelton

Victor Ng-Thow-Hing

Megan Ann Geiman

John A Gotcher

Matthew Schon Bogue

Jeffrey Edward Ruediger

Leonid Zolotarev

Benjamin Zaaron Reinhardt

Aleksei Marchenko

Yannick Pellet

Denys Bastov

Karl A Deisseroth

Dan E Andersen

Jeffrey Scott Sommers

Nicholas Atkinson Kramer

Paul Lacey

Rodolpho C Cardenuto

Federico Barbagli

Andrew Rabinovich

Eric C Browy

Christopher R Carlson

Manuela Tamayo

Daniel Andrew Garcia

Jennifer Miglionico Esposito

Lorena Pazmino

Andrea Isabel Montoya

Savannah Niles

Randall L Schlesinger

Nastasja U Robaina

Alexander Ilic

Scott Delp

Emilio Patrick Shironoshita

Daniel Lewinn Lehrich

Parag Goel

Alexander Rocha

Mario Antonio Bragg

Bach Nguyen

Praveen Babu Jd

Joyce Huang

Greg Stahler

David Moore

Toby StJohn King

Gregory Michael Broadmore

Frederic Moll

The invention relates to a viewing system for use in a surgical environment. Various real object detection devices detect locations of real objects in a real environment, such as a patient and body part of patient, medical staff, robots, a cutting tool on a robot, implant transferred by robot into body part, surgical tools, and disposable items. A map generator generates a map that forms a digital representation or a digital twin of the real environment. Various guiding modules including a room setup module, an anatomy registration module, a surgical planning module, and a surgical execution module make use of the digital representation to guide virtual or real objects based on the digital representation.

Viewing system for use in a surgical environment

An apparatus for use with an image display device configured for head-worn by a user, includes: a screen; and a processing unit configured to assign a first area of the screen to sense finger-action of the user; wherein the processing unit is configured to generate an electronic signal to cause a change in a content displayed by the display device based on the finger-action of the user sensed by the assigned first area of the screen of the apparatus.

Methods and apparatuses for providing input for head-worn image display devices

Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, totem, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The wearable system can detect when different inputs converge together, such as when a user seeks to select a virtual object using multiple inputs such as eye gaze, head pose, hand gesture, and totem input. Upon detecting an input convergence, the wearable system can perform a transmodal filtering scheme that leverages the converged inputs to assist in properly interpreting what command the user is providing or what object the user is targeting.

Identifying convergence of sensor data from first and second sensors within an augmented reality wearable device

A computer implemented method of facilitating communication between first and second users includes displaying, by a first head-worn device, a first virtual object to the first user first user wearing the first head-worn device. The method also includes displaying, by a second head-worn device, a second virtual object to the second user wearing the second head-worn device. The method further includes facilitating, by the first and second head-worn devices, communications between the first and second users using the first and second virtual objects to simulate the first and second users being present in a common environment.

Systems and methods for virtual and augmented reality

Systems and methods for matching content elements to surfaces in a spatially organized 3D environment. The method includes receiving content, identifying one or more elements in the content, determining one or more surfaces, matching the one or more elements to the one or more surfaces, and displaying the one or more elements as virtual content onto the one or more surfaces.

Matching content to a spatial 3D environment

The invention provides a content provisioning system. A mobile device has a mobile device processor. The mobile device mobile device has communication interface connected to the mobile device processor and a first resource device communication interface and under the control of the mobile device processor to receive first content transmitted by the first resource device transmitter The mobile device mobile device has a mobile device output device connected to the mobile device processor and under control of the mobile device processor capable of providing an output that can be sensed by a user.

Content provisioning system and method

The apparatus of one embodiment of the present invention is comprised of a flexible sheath instrument, a flexible guide instrument, and a tool. The flexible sheath instrument comprises a first instrument base removably coupleable to an instrument driver and defines a sheath instrument working lumen. The flexible guide instrument comprises a second instrument base removably coupleable to the instrument driver and is threaded through the sheath instrument working lumen. The guide instrument also defines a guide instrument working lumen. The tool is threaded through the guide instrument working lumen. For this embodiment of the apparatus, the sheath instrument and guide instrument are independently controllable relative to each other.

Robotic catheter system and methods

An augmented reality viewer includes components, assemblies, and executable logic to provide a user with the perception of rich augmented reality experiences, including aspects of the aquatic world.

System and method for augmented reality with virtual objects behind a physical surface

A method of viewing a patient including inserting a catheter is described for health procedure navigation. A CT scan is carried out on a body part of a patient. Raw data from the CT scan is processed to create three-dimensional image data, storing the image data in the data store. Projectors receive generated light in a pattern representative of the image data and waveguides guide the light to a retina of an eye of a viewer while light from an external surface of the body transmits to the retina of the eye so that the viewer sees the external surface of the body augmented with the processed data rendering of the body part.

Patient viewing system

Transmodal input fusion for a wearable system

Head mounted audio-visual display system connection cable

This disclosure describes techniques for receiving information that is wirelessly transmitted to a mobile computing system by wireless devices that are proximal to a route being travelled by the mobile computing system, and presenting at least a portion of the received information through a display of the mobile computing system. The information can be displayed according to a computing experience that is determined for a user of the mobile computing system (e.g., user-selected, inferred based on a stored schedule of the user, and so forth). Different sets of location-based information can be transmitted to the mobile computing system from different wireless devices that the mobile computing system comes into proximity with while traveling along a route. In some instances, the information can be locally stored on the wireless device(s) to reduce latency.

Systems and methods for virtual and augmented reality along a route with markers

An apparatus configured to be head-worn by a user, includes: a transparent screen configured to allow the user to see therethrough; a sensor system configured to sense a characteristic of a physical object in an environment in which the user is located; and a processing unit coupled to the sensor system, the processing unit configured to: cause the screen to display a user-controllable object, and cause the screen to display an image of a feature that is resulted from a virtual interaction between the user-controllable object and the physical object, so that the feature will appear to be a part of the physical object in the environment or appear to be emanating from the physical object.

Growing community of inventors

Los Altos, CA, United States of America

David Charles Lundmark