Korea Electronics Technology Institute

Junhwan Jang

Woochool Park

Junsuk Lee

Minsu Choi

Jinwook Yang

Sangpil Yoon

Jaeyoung Yang

Eunkyung Cho

Hyunwook Kim

Youngwha Kim

Bonjae Koo

Younghwa Kim

Suho Song

Proposed are a mediation server operation method for an XR streaming service and XR streaming system supporting same, the mediation server operation method comprising the steps of: if a mediation server receives an XR content playback request from a connected user device, searching for an idle split rendering server; allocating the found idle split rendering server to the user device; receiving image data and sensor data from the user device; generating a rotation matrix on the basis of the received image data and sensor data; and transmitting the rotation matrix to the allocated split rendering server.

XR streaming system for lightweight XR device and operation method therefor

A content server and method supporting low-latency content streaming are proposed. The content server may include a communication unit and a controller. The communication unit may perform communication with a user terminal. The controller may calculate coordinates for a current user's location and camera pose and create a three-dimensional (3D) space by using terminal data including an image received from the user terminal upon detecting access of the user terminal. Also, the controller may position an object in the created 3D space, render a video reproduced from a user's viewpoint as a two-dimensional (2D) video, generate server data by segmenting the rendered 2D video, and transmit the generated server data to the user terminal.

Content server and method supporting low-latency content streaming

An edge server for providing a virtual reality (VR) image is proposed. The server may include a rendering synchronization unit synchronizing a visual field and a margin with a virtual reality device. The server may also include a rendering unit generating a rendered image by rendering a visual field area corresponding to the visual field and a margin area corresponding to the margin based on a rotation center in an entire virtual reality image. The server may further include an encoding unit generating a reduced margin area by dividing a resolution of the margin area by a scaling factor, and encoding the visual field area and the reduced margin area to generate a split virtual reality image including the encoded visual field area and the encoded reduced margin area. The server may further include a streaming transmission unit transmitting the split virtual reality image to the virtual reality device.

Apparatus and method for providing split-rendered virtual reality image

An image acquisition apparatus for acquiring an in-game 360 virtual reality (VR) image by using a plurality of virtual cameras includes a virtual camera group taking in-game images by using the plurality of virtual cameras. The image acquisition apparatus may also include a renderer generating textures for the taken images, generating a panoramic image by performing an equirectangular projection (ERP) mapping of the generated textures, and encoding the generated panoramic image. The image acquisition apparatus may further include an image generator generating a 360 VR image by combining audio information with the encoded panoramic image.

Apparatus and method for acquiring in-game 360 VR image by using plurality of virtual cameras

The described technology provides a system and method of generating a 360-degree panoramic virtual reality (VR) image by using a plurality of photograph images. A plurality of image capturing devices capture and transmit the plurality of photograph images, respectively. An image conversion device receives the plurality of photograph images from the plurality of image capturing devices, calibrates each of the plurality of photograph images using characteristic information of respective one of the plurality of image capturing devices, and stitches calibrated photograph images to generate the 360-degree panoramic VR image. According to embodiments, the user can check a situation of a monitoring area while changing the viewpoint of the 360-degree panoramic VR image or enjoy the generated VR contents at a high degree of immersion.

System and method of generating panoramic virtual reality image using a plurality of photograph images

A region of interest (ROI)-based virtual reality (VR) content streaming server and a method are disclosed. The streaming server includes a communication unit that receives a request signal for a media presentation description (MPD) file regarding tiles of a tiled video, ROI) information, and a request signal for a segment file from an electronic device, and transmits the MPD file and the segment file corresponding to the request signal to the electronic device. The streaming server further includes a controller configured to, when the request signal for the MPD file is received, control the MPD file corresponding to the request signal to be transmitted to the electronic device.

ROI-based VR content streaming server and method

The present disclosure provides a system for providing an image-segmentation based streaming service. The system includes a communication circuit configured to establish a communication channel with a streaming server, a storage configured to store data provided by the streaming server, a display configured to output an image, a processor functionally connected to the communication circuit, the storage, and the display. The processor can detect a region-of-interest (ROI) of an output image associated with a media presentation description (MPD) provided by the streaming server and transmit the ROI information to the streaming server. The processor can also receive image segments of a first resolution corresponding to the ROI information and a full image of a second resolution from the streaming server. The processor can also synthesize the image segments of the first resolution and the full image of the second resolution to output a synthesized reconstruction image through the display.

Method of providing streaming service based on image segmentation and electronic device supporting the same

An electronic device and a method for a tiled video multi-channel playback are disclosed. The electronic device includes a device communication unit and a device controller. The device communication unit establishes a communication channel with a streaming server. The device controller can detect a region of interest (ROI) of an image related to a media presentation description (MPD) tile provided by the streaming server, transmit ROI information to the streaming server and receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server. The device controller can also generate a 360-degree VR video by synthesizing the video tiles and the full video, and control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.

Electronic device and method for tiled video multi-channel playback

Disclosed are a video conversion apparatus and a system for generating a 360-degree VR video in real time. The video conversion apparatus includes an input unit and a controller. The input unit receives a plurality of pieces of video information having continuity from a video recording apparatus including a plurality of cameras. The controller captures the plurality of pieces of video information received from the input unit, encodes the captured pieces of video information in a parallel structure, and stitches the encoded pieces of video information to generate a 360-degree VR video.

Growing community of inventors

Goyang-si, South Korea

Junhwan Jang