Shanghai Bilibili Technology Co., Ltd.

Longwen Gao

Yingxuan Shi

Zhiwei Chen

Chaoran Li

Ruoheng Liu

Junxing Tang

Pengcheng Li

Kangkang Zhang

Yi Bin Wang

Bo Wang

Hui Chen

Jianqiang Ding

Tianxiao Ye

Qi Tang

Xiang Zhu

Jingqiang Zhang

Qiang Fu

Lulu Yu

Xiaolong Yan

Dada Liao

This application provides techniques for generating a video cover. The techniques comprise monitoring whether the browser enters a target page; initializing a main thread and creating a frame extraction thread and an image evaluation thread; monitoring a target action on the target page extracting a plurality of target frames from the local video file using the webassembly video parser running by the frame extraction thread; determining image evaluation parameters of each of the plurality of target frame using the trained image evaluation model running by the image evaluation thread; obtaining the image evaluation parameters of each of the plurality of target frames from the image evaluation thread by the main thread, selecting one or more candidate frames from the plurality of target frames based on the image evaluation parameters of each of the plurality of target frames, and generating the video cover based on the one or more candidate frames.

Method and system for generating video cover based on browser

Techniques for displaying comments relative to a video frame are described herein. The disclosed techniques include receiving a frame of a video; receiving bullet screen data comprising a plurality of comments associated with the frame; receiving a mask frame data segment corresponding to the frame; determining a mask area based on the mask frame data segment, wherein the mask area corresponds to a main area of the frame; and displaying the plurality of comments relative to the frame in areas other than the mask area.

Method of displaying comment information, computing device, and readable storage medium

The present disclosure describes techniques for generating a mask frame data segment corresponding to a video frame. The disclosed techniques include obtaining a frame of a video; identifying a main area of the frame using an image segmentation algorithm; and generating a mask frame data segment corresponding to the frame based on the main area of the frame, wherein the generating a mask frame data segment corresponding to the frame based on the main area of the frame further comprises generating the mask frame data segment based on a timestamp of the frame in the video, a width and a height of the main area of the frame.

Method of obtaining mask frame data, computing device, and readable storage medium

The present disclosure describes techniques of processing information flow and synchronously displaying image s, mask frames and comment information. According to the present disclosure, a system processes a first information stream uploaded by a stream pushing terminal to obtain a frame image and mask frame data, the mask frame data corresponding to the frame image and identifying a timestamp offset indicative of a time difference between the mask frame data and a playing timestamp of the frame image. The system synthesizes the frame image and the mask frame data to generate a second information stream; and output the second information stream to a client for synchronously displaying the image frame, a corresponding mask frame, and the comment information.

Method and system of processing information flow and method of displaying comment information

The present disclosure describes techniques for implementing user interface interaction. The disclosed techniques comprise playing a video on an interface; monitoring user input performed on the interface; determining a target frame based at least in part on the user input; determining a location where the user input is performed on the interface; determining whether the location of the user input is in a predetermined area of the target frame, wherein the predetermined area is associated with at least one object in the target frame; and implementing an operation associated with the at least one object in response to determining that the location of the user input is in the predetermined area of the target frame.

User interface interaction method and system

Techniques for processing a multimedia file in real-time are described herein. The disclosed techniques include receiving a plurality of fragments of a multimedia file by a data stream conversion service, wherein the data stream conversion service receives a first fragment containing metadata of the multimedia file and then receives other fragments of the multimedia file in a predetermined order; sending a notification message to a message queue by the data stream conversion service in response to receiving the first fragment, wherein the notification message includes the metadata of the multimedia file and a corresponding Hyper Text Transfer Protocol (HTTP) interface address; obtaining the notification message from the message queue by an encoding and decoding service; and processing the other fragments of the multimedia file based at least in part on the notification message by the encoding and decoding service.

Multimedia file processing

Growing community of inventors

Shanghai, China

Longwen Gao