University of Washington

Howard Jay Chizeck

Fredrik Ryden

Andrew Stewart

Tamara Bonaci

Thomas Sean Lendvay

Blake Hannaford

Jeffrey Herron

Oliver Crandall Johnson

Nicklas Gustafsson

Kevin Huang

Fredrik Rydén

Sina Nia Kosari

Hawkeye I King

Fredrik RYDÉN

Apparatus and methods for generating virtual environment displays based on a group of sensors are provided. A computing device can receive first data about an environment from a first group of one or more sensors. The computing device can model the environment as a virtual environment based on the first data. The computing device can determine whether to obtain additional data to model the environment. After determining to obtain additional data to model the environment, the computing device can: receive second data about the environment, and model the environment as the virtual environment based on at least the second data. The computing device can generate a display of the virtual environment.

Integration of auxiliary sensors with point cloud-based haptic rendering and virtual fixtures

Apparatus and methods for defining and utilizing virtual fixtures for haptic navigation within real-world environments, including underwater environments, are provided. A computing device can determine a real-world object within a real-world environment. The computing device can receive an indication of the real-world object. The computing device can determine a virtual fixture that corresponds to the real-world object based on the indication, where aspects of the virtual fixture are configured to align with aspects of the real-world object. The computing device can provide a virtual environment for manipulating the robotic tool to operate on the real-world object utilizing the virtual fixture. The virtual fixture is configured to provide haptic feedback based on a position of a virtual robotic tool in the virtual environment that corresponds to the robotic tool in the real-world environment.

Haptic virtual fixture tools

Methods, articles of manufacture, and devices related to generating six degree of freedom (DOF) haptic feedback are provided. A computing device can receive first depth data about an environment. The computing device can generate a first plurality of points from the first depth data. The computing device can determine a virtual tool, where the virtual tool is specified in terms of a translation component for the virtual tool and a rotation component for the virtual tool. The computing device can determine a first force vector between the virtual tool and the first plurality of points. The computing device can send a first indication of haptic feedback based on the first force vector.

Methods and systems for six-degree-of-freedom haptic interaction with streaming point data

Methods and systems for securing remotely-operable devices are provided. A security device can receive a plurality of commands to control a remotely-operable device in a remote environment. At least one command in the plurality of commands can include command data that is related to the remotely-operable device. The security device can receive a plurality of responses to the plurality of commands. The security device can process the plurality of commands and the plurality of responses to determine a signature related to an operator that issued the plurality of commands for the remotely-operable device. The security device can determine an identity of the operator based on the signature. The security device can generate an identity report that includes the identity of the operator.

Enhanced security and safety in telerobotic systems

Methods and systems for securing remotely-operable devices are provided. A remotely-operable device can receive a command related to a component of the remotely-operable device operating in an environment. The remotely-operable device can include a reality-rules database (RRDB) that is configured to store a plurality of reality rules with each reality rule relating to a constraint on the remotely-operable device. The remotely-operable device can determine a reasonableness value for the command based on a constraint, where the constraint is determined based on a constraint related to at least one reality rule of the plurality of reality rules stored in the RRDB. The remotely-operable device can encode the reasonableness value for the command in a feedback message. The remotely-operable device can send the encoded feedback message from the remotely-operable device.

Using supplemental encrypted signals to mitigate man-in-the-middle attacks on teleoperated systems

Methods and systems for six degree-of-freedom haptic interaction with streaming point data

Methods, articles of manufacture, and devices related to generating haptic feedback for point clouds are provided. A computing device receives depth data about an In-Contact environment. The computing device generates a point cloud from the depth data. The computing device determines a haptic interface point (HIP). The computing device determines a haptic interface point (HIP). The computing device determines a force vector between the HIP and point cloud. The computing device sends an indication of haptic feedback based on the force vector.

Methods and systems for haptic rendering and creating virtual fixtures from point clouds

Methods and apparatus for using are provided for using neural signals to drive touch screen devices. An electromyography (EMG) device can receive neural based on electrical activity of one or more voluntary muscles of a user of the EMG device. The EMG device can filter the neural signals to generate a plurality of channel signals. A touch event can be determined based on the plurality of channel signals. The touch event can relates to user input for a touch-based interface of a touch-enabled device. The touch-enabled device can receive an indication of the touch event. The touch-enabled device can determine a touch operation for the touch-enabled device based on the touch event and then perform the touch operation.

Growing community of inventors

Mercer Island, WA, United States of America

Howard Jay Chizeck