International Business Machines Corporation

Xiao Rui Shao

Jian Jun Wang

Yuan Jin

Yin Qian

Yu Huang

Cheng Peng

Xiao Cao Cao

Chengyu Peng

Li Ping Wang

Fei Shen

Xiao Feng Ji

Jin Long L L He

Yu Hong Y L Li

Aspects of the present disclosure relate to automatically generating a user manual using a technique that includes training a first model with a first set of training data. The technique further includes generating, by the first model, a set of operations and a set of windows, where the set of operations and the set of windows are functions of the program. The technique further includes, generating a plurality of tasks, where a first task comprises a first operation being performed on a first window. The technique further includes determining an order of the plurality of tasks and calculating a level score for the first operation of the first window. The technique further includes assembling the user manual having the plurality of tasks in the determined order.

Intelligent generation and organization of user manuals

Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.

Barrage message processing

A method and system of converting a first language of a soundtrack of a person speaking in a video to a second language. A meaning of a word of the first language is translated, and one or more synonym words in the second language stored in a database of the computer system is located. The first and second languages are different languages. Outlines of shapes of mouth openings of the one or more synonym words in the second language are compared with the outlines of the shapes of mouth openings of the word of the first language. A synonym word of the one or more synonym words translated from the second language into the first language having mouth openings with a smallest difference from the mouth openings of the word of the first language is selected.

Dubbing and translation of a video

Disclosed embodiments provide techniques for suggesting images that can be conveniently included in electronic communication such as social media posts, emails, text messages, and other forms of electronic communication, based on voice input and/or emotion analysis from facial expressions of a user. A speech-to-text process converts a user's spoken utterance to text. Natural language processing performs an entity extraction on the utterance to generate a scenario summary. An image database is queried using the scenario summary and/or emotion analysis based on user facial images. A mapping rule library may be used to perform the image database query. Based on the scenario summary and/or the emotion analysis, images are presented to the user as recommended for including in an electronic communication message such as a social media post, email, or text message.

Method and system to recommend images in a social application

The present invention provides a method and system for converting a first language of a soundtrack of a person speaking in a video to a second language. The method defines an outline of a shape of a mouth opening of the person speaking a syllable of a word of the first language in the video at a given start time by selecting a predetermined number of points along a border of the mouth opening defined by the lips. A length of the spoken syllable is also measured and one or more adjacent syllables are combined to create a word. The word is translated into synonym words in the second language, the best fit synonym word is selected that most closely matches the mouth shape of the first language word, and a mouth shape adjustment script is applied to fine tune the mouth shape of the best fit synonym word.

Growing community of inventors

Shanghai, China

Xiao Rui Shao