Samsung Electronics Co., Ltd.

Zte Corporation

Youxin Chen

Jie Chen

Longhai Wu

Yuxiang Shan

Bo Wang

Jie Wu

Cheulhee Hahm

Kun Peng Wang

Wei Ma

Jayoon Koo

Yingying Jiang

Jiang Yu

Xin Jin

Guotao Shen

Jichun Li

Shuli Yang

Mengze Wang

Chuanxiao Liu

Chengbin Zeng

A method and a system for rendering video images in virtual reality (VR) scenes are provided. The method includes providing a video image at a current time point, dividing the video image at the current time point into a plurality of sub-regions, inputting image feature information of the sub-regions and acquired user viewpoint feature information into a trained attention model for processing to obtain attention coefficients of the sub-regions indicating probability values at which user viewpoints at a next time point fall into the sub-regions, rendering the sub-regions based on the attention coefficients of the sub-regions to obtain a rendered video image at the current time point, inputting the attention coefficients of the sub-regions and the image feature information of the sub-regions into a trained user eyes trajectory prediction model for processing, obtaining user eyes trajectory information in a current time period, dividing, for video images at subsequent time points within the current time period, the video images at the subsequent time points into a plurality of sub-regions, calculating attention coefficients of the sub-regions in a video image at each of the subsequent time points within the current time period respectively based on the user eyes trajectory information in the current time period, and rendering the corresponding sub-regions based on the attention coefficients of the sub-regions to obtain a rendered video image at each of the subsequent time points.

Method for rendering video images in VR scenes

A method for generating a video intermediate frame, including obtaining a target video frame pair; constructing an image pyramid for each video frame in the target video frame pair; and generating an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid, wherein the generating of the intermediate frame of the target video frame pair comprising: repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model, and repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.

Method and apparatus for generating video intermediate frame

A method for controlling an electronic device is provided. The method includes obtaining an intermediate image by preprocessing an original image, obtaining a saliency feature map of the intermediate image by performing semantic saliency analysis on the intermediate image, performing adaptability calculation according to the saliency feature map and a retargeted target equipment condition, and determining a retargeting mode of the original image according to the result of the adaptability calculation, and performing retargeting processing on the original image according to the determined mode.

Image retargeting method and device

Provided are a device and a method for acquiring music information about music played in an electronic device, acquiring a storyline of the music based on the music information, and acquiring and displaying one or more images based on the storyline.

Method and device for playing multimedia

A formula inputting method is provided. The formula inputting method includes receiving a handwriting input of a user; obtaining handwriting content based on the handwriting input of the user; determining at least one or more recommended content based on the handwriting content; and displaying the handwriting content and the one or more recommended content.

Formula inputting method and apparatus

A method of generating handwriting information about handwriting of a user includes determining a first writing focus and a second writing focus; sequentially shooting a first local writing area, which is within a predetermined range from a first writing focus, and a second local writing area, which is within a predetermined range from a second writing focus; obtaining first handwriting from the first local writing area and second handwriting from the second local writing area; combining the first handwriting with the second handwriting; and generating the handwriting information, based on a result of the combining.

Handwriting recognition method and apparatus

The present invention provides a method and device for realizing Chinese character input based on uncertainty information, wherein the method comprises: receiving input information from a user; extracting at least two types of uncertainty information of Chinese characters to be input, from the input information; and, determining the matched Chinese characters according to the at least two types of uncertainty information and outputting the matched Chinese character(s). The device comprises a receiving module, an extracting module and a matching module. The method and device as provided by the present invention allow a user who has incomplete memory of pronunciation or glyph information of Chinese characters to be input to realize correct input of the Chinese characters by defining a certain range for candidate characters corresponding to the Chinese characters to be input, in combination with at least two types of the extracted uncertainty information of the Chinese characters to be input.

Method and device for realizing chinese character input based on uncertainty information

Growing community of inventors

Beijing, China

Youxin Chen