Electronics and Telecommunications Research Institute

Seong Min Baek

Sung Jin Hong

Jong Sung Kim

Myung Gyu Kim

Hee Sook Shin

Il Kwon Jeong

Youn Hee Gil

Cho Rong Yu

Youn-Hee Gil

Sang Woo Seo

Cho-Rong Yu

Woo Suk Kim

Do-Hyung Kim

Yong Ho Lee

Chang Joon Park

Seong Il Yang

Ji Hyung Lee

Seung Woo Nam

In Ho Lee

Byoung Tae Choi

Hee Kwon Kim

Ye Jin Kim

Sungjin Hong

A system and method for providing a virtual reality service is provided. For the system and method capable of realizing an interaction image of a user's full body, the system includes a head-mounted device mounted on the head of the user, a first RGB-D sensor configured to be installed on the head-mounted device, generate first image data of the user, and be arranged to face the user, a second RGB-D sensor configured to be installed on the head-mounted device, generate second image data of the user, and be arranged to face the user, and a calculation device configured to obtain a skeleton image of the user on the basis of the first image data and the second image data, obtain posture information of the user on the basis of the skeleton image of the user, and generate an interaction image on the basis of the posture information of the user.

System and method for providing virtual reality service

A method and an apparatus for virtual training based on tangible interaction are provided. The apparatus acquires data for virtual training, and acquires a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data. Then, virtualization of an overall appearance of a user is performed by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information, and depth data and color data for the user obtained according to virtualization of the user is visualized in virtual training content. In addition, the apparatus performs correction on joint information using the joint information and the depth information included in the obtained data, estimates a posture of the user using the corrected joint information, and estimates a posture of a training tool using the depth information and IR data included in the obtained data.

Method and apparatus for virtual training based on tangible interaction

A method of supporting self-learning and a system for performing the method are disclosed. The method includes estimating an object of interest of a user in content based on user performance information inputted by the user in response to content situation information and the content being received from a learning module including the content, analyzing the content situation information, determining whether to generate support information for supporting the user to perform the content based on the estimated object of interest and the analyzed content situation information, and generating the support information that allows the user to self-learn the content according to whether to generate the support information, and outputting the support information to the learning module.

Method of supporting self-learning and system for performing the same

A virtual content providing device includes: a communication circuit capable of communicating with a wearable device worn by a user; and a processor functionally connected to the communication circuit. The processor is configured to: display virtual training content on the wearable device through the communication circuit; generate training situation information and user condition information associated with the virtual training content through the wearable device; determine a intervention time point for the virtual training content based on the training situation information and the user condition information; generate virtual intervention content associated with the intervention time point; and display the virtual intervention content in synchronization with the virtual training content through the wearable device.

Wearable device, virtual content providing device, and virtual content providing method

Provided are an apparatus and method for experiencing an augmented reality (AR)-based screen sports match which enable even a child, an elderly person, and a person with a disability to easily and safely experience a ball sports match, such as tennis, badminton, or squash, as a screen sports match without using a wearable marker or sensor, a wearable display, an actual ball, and an actual tool.

Apparatus and method for experiencing augmented reality-based screen sports match

A system for recognizing collision positions of a plurality of moving objects in a screen includes an infrared camera configured to obtain an image frame when a plurality of moving objects move toward a screen, a memory configured to store a program for calculating a collision position in the screen on the basis of the image frame, and a processor configured to execute the program stored in the memory. By executing the program, the processor detects all of the plurality of moving objects from the image frame to generate a graph where moving objects included in a successive image frame are connected to one another, and calculates a collision position of the moving object included in the image frame and a collision position of the moving object in the screen on the basis of the graph.

System and method of recognizing collision position of screen

Provided are a system and method for simultaneously reconstructing an initial three-dimensional (3D) trajectory and velocity of an object by using single camera images. The system for simultaneously reconstructing an initial 3D trajectory and velocity of an object by using single camera images includes a receiver configured to receive 3D world coordinate information of a starting point of an object and object-captured image information of a single camera, a two-dimensional (2D) coordinate acquisition unit configured to acquire 2D image coordinates of the object from the object-captured image information, and a reconstructor configured to simultaneously reconstruct an initial 3D velocity and trajectory of the object by applying a 3D motion equation to the 2D image coordinates and depth information from the single camera to the object.

System and method for simultaneously reconstructing initial 3D trajectory and velocity of object by using single camera images

An apparatus for generating a 3-dimensional character motion via timing transfer. The apparatus includes an example motion database configured to store data about one or more example motions of characters with an identical skeleton model structure; an example motion analyzer configured to generate a timing source by analyzing timing in a designated example motion data among the one or more example motion data stored in the example motion database; and an input motion transfer part configured to re-adjust spatial movements in an input motion in correspondence with the generated timing source so as to generate an output motion.

Apparatus and method for generating 3D character motion via timing transfer

Disclosed are a method and apparatus for measuring rotation characteristics such as rotation rate, rotation axis, and rotation angle of a rotating body. A method of measuring rotation characteristics includes extracting a rotating-body region from an image of the rotating body; extracting a surface pattern of the rotating body on the basis of brightness values of the extracted rotating-body region and acquiring rotation characteristics of the rotating body on the basis of change in the extracted surface pattern. Accordingly, it is possible to accurately measure rotation characteristics regardless of variation in brightness values of a surface region of the rotating body depending on illumination of a lamp, sensitivity of a camera, and exposure time of a camera.

Method and apparatus for measuring rotation characteristics of rotating body

Disclosed are an apparatus and a method for measuring a speed of a rotation body and recognizing a spin using a line scan. The present invention provides an apparatus and a method for calculating a motion of an object capable of acquiring line scan images using some lines of an area scan camera and calculating a three-dimensional speed and a three-dimensional spin of a rotation body by using a composite image in which the line scan images are coupled. The present invention can provide a realistic game or training at low cost by providing realistic physical simulation of the rotation body while allowing a competitive price when producing products by using the existing inexpensive camera.

Apparatus and method for calculating motion of object

Disclosed is a method for automatically extracting centroids and features of a spherical object required to measure a flight speed, a flight direction, a rotation speed, and a rotation axis of the spherical object in a system for measuring flight information of the spherical object with a high-speed stereo camera. In order to automatically extract the centroids and the features of the spherical object, the present invention may automatically extract the centroid and the feature by detecting only the pixel of the foreground image including the spherical object generated by excluding the motionless background image from each camera image, sorting the interconnected pixels among the pixels of the detected foreground image into the independent pixel cluster, and then, using, in the extraction of the centroid and the feature, only one pixel cluster having a size similar to the actual spherical object.

System and method for measuring flight information of a spherical object with high-speed stereo camera

A high-speed marker-free motion capture, which is capable of powerfully detecting a body's feature points corresponding to a body's end portions such as a head, hands, feet, trunk, arms and legs at a high speed in an illumination change or background or noises of cameras. The extracted feature points of the body can be directly tracked stably in a 3-dimensional space. The position errors of the feature points due to the change of the illumination conditions or a shadow can be automatically corrected and the feature points can be stably tracked with respect to overlapping and disappearance of the feature points. Further, when coordinates of the middle joints are estimated using 3-dimensional coordinates of the extracted feature points of the body, the present invention restores a human model by estimating the positions of the middle joints of the actor with high accuracy without using a motion database, thereby securing the stability and reality of the 3-dimensional motion data required in the motion capture.

Growing community of inventors

Daejeon, South Korea

Seong Min Baek