Baidu USA LLC

Baidu.com Times Technology (beijing) Co. Ltd.

Beijing Baidu Netcom Science Technology Co., Ltd

Daming Lu

Hao Tian

Xi Chelsea Chen

Jeff Chienyu Wang

Xi Chen

Zhihong Pan

Xing Li

Le Kang

Xin Zhou

Zhiyu Cheng

Yichen Hu

Dapeng Li

Jingya Xun

Presented herein are systems, methods, and datasets for automatically and precisely generating highlight or summary videos of content. In one or more embodiments, the inputs comprise a text (e.g., an article) of the key event(s) (e.g., a goal, a player action, etc.) in an activity (e.g., a game, a concert, etc.) and a video or videos of the activity. In one or more embodiments, the output is a short video of an event or events in the text, in which the video may include commentary about the highlighted events and/or other audio (e.g., music), which may also be automatically synthesized.

Generating highlight video from video and text inputs

According to one embodiment, a method is provided for video repainting performed by at least one processor of a computer device. The method includes receiving a video sequence having one or more image frames; detecting presences of a target object within the one or more image frames and determining pose condition and style shift of the detected objects; generating content representing a replacement object for the one or more image frames by applying the corresponding pose condition and style shift to the replacement object; and repainting the detected target object in the one or more image frames with the generated content.

System and process for repainting of planar objects in video

The present disclosure provides examples of a method and apparatus for processing a video, a device and a storage medium. The method may include: acquiring a target video and a target comment of the target video; recognizing a picture in the target video to obtain text information of the picture; determining a target comment matching a content of the text information; and inserting, in response to displaying the picture in the target video, the target comment matching the content in a form of a bullet screen.

Method for processing video, device and storage medium

Presented herein are systems and methods for an end-to-end solution for object removal from a video using adaptive learning. In one or more embodiments, using a pre-trained image inpainting model, in-scene training data may be generated using optical-flow guided sampling. In one or more embodiments, the sampled patches are used to generate a training dataset, which is used to further train the image inpainting model until reaching a stop condition. The adaptively trained inpainting model may be used to generate a modified video in which the desired object or objects have been removed and the corresponding removed portion(s) have been filled (or inpainted) to preserve the integrity of the image.

Video content removal using flow-guided adaptive learning

Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.

Method and apparatus for aligning paragraph and video

Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.

Method and apparatus for generating commentary

The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: recognizing a person name in a news text; searching a video based on the person name, to obtain a to-be-selected video; extracting a key frame in the to-be-selected video; recognizing a person in the key frame to obtain identity information of the person; and determining the to-be-selected video as video material of news, in response to the identity information of the person conforming to the person name. The present disclosure improves the consistency between the video material of the news and the news text.

Method and apparatus for determining (raw) video materials for news

Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.

Method and apparatus for generating information

A method and apparatus for adjusting a parameter are provided. The method may include: acquiring a current value of at least one parameter which is in a process of generating a video corresponding to a commentary of the news cluster based on a news cluster; determining a video evaluation score of the video which is generated based on the news cluster and according to the current value of the at least one parameter; performing feature extraction on the current value of the at least one parameter to obtain a feature representation; inputting the feature representation and the determined video evaluation score into a pre-trained evaluation network to obtain a predicted video evaluation score; inputting the feature representation and the predicted video evaluation score into a pre-trained operation network, to obtain current operation information; and adjusting the current value of the at least one parameter based on the current operation information.

Growing community of inventors

Sunnyvale, CA, United States of America

Daming Lu