Technische Universitát Dresden

Technische Universitaet Dresden

Uwe Marschner

Andreas Richter

Georgi Paschew

René Körbitz

Konrad Henkel

Maxim Germer

The system according to the invention for haptic interaction with virtual objects comprises a visualisation unit for visualising virtual objects and the user's hand, a haptic output unit for reproducing haptic impressions at least by means of force feedback on fingertips of the user's hand, and a data processing unit for processing input data and controlling the visualisation unit and the output unit. The output unit has at least two movement-coupled segments of the interaction region, a finger-based positioning system, and a global positioning system, as well as a sensor system and actuator system. The movement-coupled segments are designed as touch surfaces, and each movement-coupled segment is assigned to one fingertip of the user's hand and can be moved by the latter. The position of the fingertip on the movement-coupled segment can be changed. The sensor system is used to detect the position of the movement-coupled segment with respect to the virtual object and the contact forces between the movement-coupled segments and the fingertips of the user's hand, while the actuator system serves for positioning the movement-coupled segments with respect to the virtual object and for exerting contact forces on the fingertips of the user's hand by means of the movement-coupled segments. A base reference plane for the force feedback is assigned to the haptic output unit.

System for haptic interaction with virtual objects for applications in virtual reality

The invention relates to a system and a method for haptic interaction with virtual objects. The system of the invention is based on the idea that, for the haptic representation of any virtual three-dimensional object&#x2014;synchronized with the visual representation&#x2014;only the tangible haptic characteristics of the surface area of the object at the collision point or the area of contact are important. The haptic display system (morphling) of the invention that displays these characteristics comprises in principle three functional groups, which operate in synchronism with one another and with a visual subsystem. The individual subsystems can be operated statically or dynamically. In dynamic operation, users can change the position and/or shape, for example, of the tactile display by touching it. With regard to the real-time representation of the three-dimensional data of the user, at least the body part that is interacting with the object, e.g. the hand, must be represented in the visual system; the body part may also be directly visible, as with a head-up display. Ideally, all body parts of the user that lie within the user's field of view are displayed visually. With the synchronized real-time combination in the visual subsystem, users and objects that are actually spatially separated are displayed virtually in a defined spatial proximity. In this virtual representation, the user thus sees himself touching the virtual object. At the time of collision and at the collision point, however, he does not actually interact with the object represented in the visual system, but with a haptic display subsystem, the morphling, in a tactile subsystem which, in the tangible portion of the virtual object, displays the object's haptic characteristics, e.g. its surface condition and shape, synchronized in real time with the visual representation. The interaction between the at least one body part of the visualized user and the visualized object are represented in the visual subsystem simultaneously with the interaction of the user with the tactile display system, and upon collision of the at least one part of the visualized user with the visualized object, a collision point is determined. The three-dimensional data of the object at the collision point of the at least one part of the visualized user with the visualized object are presented in the tactile subsystem, the haptic element having a surface with structuring that is designed such that the haptic element displays the three-dimensional structure of the object at the collision point based on the captured three-dimensional data of the object, at least in the area of the collision point.

System and method for haptic interaction with virtual objects

Growing community of inventors

Coswig, Germany

Uwe Marschner