Sejong University

Yong Guk Go

Soo Mi Choi

Dong Hyun Kim

Jong Won Lee

Ho San Kang

Mun Su Yu

A remote training apparatus for a drone flight in a mixed reality includes: a processor; and a memory, wherein the memory stores program instructions executable by the processor to generate a virtual flight space using arrangement information of one or more anchors and tags arranged in a physical space for the flight of the drone, and receive and register a flight training scenario generated in the virtual flight space from a second computer belonging to a remote expert group that remotely communicates with a first computer belonging to a drone operator group, wherein the flight training scenario includes one or more virtual obstacles and one or more flight instruction commands, and at least some of the flight instruction commands are mapped to the one or more virtual obstacles, and receive one or more annotations generated by the remote expert group from the second computer to transmit the annotations to the first computer.

Remote training method and apparatus for drone flight in mixed reality

Disclosed are a method and an apparatus for generating a mixed reality environment using a drone equipped with a stereo camera including a processor and a memory connected to the processor, wherein the memory stores program commands executed by the process to receive an image acquired by a stereo camera equipped with a drone and a depth value, identify an object from the image, convert a 2D central point coordinate of the identified object to a 3D coordinate through 3D mapping using the depth value, linear-interpolate a 3D coordinate of the object using a 3D coordinate of the object in a previous frame, a 3D coordinate of the object in a current frame, and a weight value, determine a position of a virtual object in association with the linear-interpolated 3D coordinate of the object, and render a mixed reality image including the virtual object.

Growing community of inventors

Namyangju-si, South Korea

Yong Guk Go