Purdue Research Foundation

Ke Huo

Karthik Ramani

Vinayak Raman Krishnamurthy

Ji-Xin Cheng

Lu Lan

Tianyi Wang

Yuanzhi Cao

Pu Wang

Yan Xia

A method and system for localizing a plurality of stationary devices, such as Internet of Things (IoT devices), arranged in an environment is disclosed. A mobile device is configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile device and the stationary devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the devices using wireless ranging techniques. Based on the measured distances, the mobile device is configured to determine locations of the stationary devices in a reference frame of the three-dimensional map. In some embodiments, the determined locations can be used to enable a variety of spatially aware augmented reality features and interactions between the mobile device and the stationary device.

System and method for spatially mapping smart objects within augmented reality scenes

A system and method for authoring and performing Human-Robot-Collaborative (HRC) tasks is disclosed. The system and method adopt an embodied authoring approach in Augmented Reality (AR), for spatially editing the actions and programming the robots through demonstrative role-playing. The system and method utilize an intuitive workflow that externalizes user's authoring as demonstrative and editable AR ghost, allowing for spatially situated visual referencing, realistic animated simulation, and collaborative action guidance. The system and method utilize a dynamic time warping (DTW) based collaboration model which takes the real-time captured motion as inputs, maps it to the previously authored human actions, and outputs the corresponding robot actions to achieve adaptive collaboration.

System and method for embodied authoring of human-robot collaborative tasks with augmented reality

A lesion detection system for use with a patient, comprising an optoacoustic guide wire assembly configured to be insertable into a patient's tissue. The optical acoustic guide wire assembly can be comprised of an optical waveguide have a first end and a second end, a light source coupled to the second end of the optical waveguide, wherein said light source configured to emit energy to the patient's tissue, at least one transducer configured to detect an ultrasound signal emitted from the patient's tissue in response to energy emitted from the light source, and a computer system.

Intraoperative optoacoustic guide apparatus and method

A virtual reality system, comprising an electronic 2d interface having a depth sensor, the depth sensor allowing a user to provide input to the system to instruct the system to create a virtual 3D object in a real-world environment. The virtual 3D object is created with reference to at least one external physical object in the real-world environment, with the external physical object concurrently displayed with the virtual 3D object by the interface. The virtual 3D object is based on physical artifacts of the external physical object.

Window-shaping virtual reality system

A method and system for enabling a self-localizing mobile device to localize other self-localizing mobile devices having different reference frames is disclosed. Multiple self-localizing mobile devices are configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the mobile devices using wireless ranging techniques. Based on the measured distances and self-localized positions in the environment corresponding to each measured distance, at least one of the mobile devices is configured to determine relative rotational and translational transformations between the different reference frames of the mobile devices. Based on the determined transformations, the mobile devices are able to localize the other mobile devices in their own reference frames, which can enable a variety of spatially aware augmented reality features and interactions.

Growing community of inventors

West Lafayette, IN, United States of America

Ke Huo