Snap Inc.

Alexander Mashrabov

Victor Shaburov

Ivan Semenov

Sofia Savinova

Roman Golobokov

Dmitriy Matov

Grigoriy Tkachenko

Ivan Babanin

Alexey Pchelnikov

Andrew Osipov

Evgenii Krokhalev

Ivan Belonogov

Described are systems and methods for generating personalized videos with customized text messages. An example method commences with receiving an input text and a video template. The video template includes a sequence of frame images and text parameters defining an animation of the input text for the sequence of frame images. The method continues with rendering an output video. The output video includes the sequence of frame images featuring the input text rendered according to the text parameters. The method further includes providing a user with an option to change at least one text parameter of the text parameters. The method continues with dynamically changing, by the at least one computing resource, the input text according to the at least one text parameter. The method further includes providing, by the at least one computing resource, the output video to at least one further computing resource via a communication chat.

Generating personalized videos with customized text messages

Disclosed are systems and methods for personalized videos. An example method include receiving, by a computing device, preprocessed videos including a target face, providing, by the computing device, a first user interface enabling a user to generate an image of a source face, modifying, by the computing device, the preprocessed videos to generate one or more personalized videos by replacing the target face with the source face, the source face being modified to adopting a facial expression of the target face, and providing, by the computing device, a second user interface to select the one or more personalized videos.

Personalized videos

Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of skin masks defining positions of a skin area of a part of the at least one body in the frame images. The method may continue with receiving an image of a source face. The method may further include determining color data associated with the source face. The method may include recoloring the skin area of the part of the at least one body in the frame image and inserting the image of the source face into the frame image at a position determined by face area parameters corresponding to the frame image to generate an output frame of an output video.

Template-based generation of personalized videos

A method for searching and ranking personalized videos includes receiving a user request via a communication chat between a user and another user. The user request includes a phrase. The method performs, based on the phrase, a search in a first pool of pre-rendered videos to determine a first subset of relevant videos ranked according to first rankings. The pre-rendered videos include pre-rendered text messages. The method performs a search in a second pool of customized videos to determine a second subset of relevant videos ranked according to second rankings. The customized videos include text messages modified by the user. The method generates a set of videos. The set of videos includes a first number of pre-rendered videos from the first subset of relevant videos and a second number of customized videos from the second subset of relevant videos. The method presents the set of videos via the communication chat.

Searching and ranking personalized videos

Provided are systems and methods for personalized videos featuring multiple persons. An example method includes receiving a user selection of a video having at least one frame with metadata that include a first location and a second location and receiving an image of a source face and a further image of a further source face, modifying the image of the source face to generate an image of a modified source face and modifying the further image of the further source face to generate an image of a modified further source face, inserting, in the at least one frame of the video, the image of the modified source face at the first location and the image of the modified further source face at the second location to generate a personalized video, and sending the personalized video via a communication chat.

Personalized videos featuring multiple persons

Disclosed are systems and methods for providing personalized videos. An example method includes storing one or more preprocessed videos. The one or more preprocessed videos may include at least one frame with at least a target face. The method may continue with receiving an image of a source face, for example, by receiving a user selection of a further image and segmenting the further image into portions including the source face and a background. The method may then proceed with modifying the one or more preprocessed videos to generate one or more personalized videos. The modification may include modifying the image of the source face to generate an image of a modified source face. The modified source face may adopt a facial expression of the target face. The modification may further include replacing the at least one target face with the image of the modified source face.

Described are systems and methods for generating personalized videos with customized text messages. An example method may commence with receiving a video template. The video template may include a sequence of frame images and preset text parameters defining an animation of a text. The method may continue with generating a configuration file based on the text and the preset text parameters. The configuration file may include text parameters defining rendering the text for each of the frame images. The method may further include receiving an input text and rendering an output video comprising the sequence of frame images featuring the input text rendered according to the text parameters. The rendering may be performed based on the configuration file. The method may continue with sending the output video to a further computing device via a communication chat.

Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of facial landmark parameters defining positions of facial landmarks in the frame images. The method may continue with receiving an image of a source face. The method may further include generating an output video. The generation of the output video may include modifying a frame image of the sequence of frame images. Specifically, the image of the source face may be modified to obtain a further image featuring the source face adopting a facial expression corresponding to the facial landmark parameters. The further image may be inserted into the frame image at a position determined by face area parameters corresponding to the frame image.

An example method for searching and ranking personalized videos commence with receiving a user request via a communication chat between a user and another user. The user request includes a phrase or emoji. The method performs, based on the user request, a search of a pool of personalized videos to determine a subset of relevant personalized videos. The personalized videos are associated with text messages. The method further includes determining first rankings of the relevant personalized videos. The method then proceed with selecting, based on the first rankings, a pre-determined number of personalized videos from the subset of relevant personalized videos. The method then determines second rankings of the selected personalized videos and present the selected personalized videos within the communication chat in an order based on the second rankings. The personalized videos of the first subpool and the personalized videos of the second subpool are ranked independently.

Systems and methods for searching and ranking personalized videos

Disclosed are systems and methods for providing personalized videos featuring multiple persons. An example method includes receiving a user selection of a video having at least one frame with at least a target face and at least one further target face and receiving an image of a source face and a further image of a further source face. The method further includes modifying the image of the source face to generate an image of a modified source face and modifying the further image of the further source face to generate an image of a modified further source face. In the at least one frame of the video, the target face is replaced with the image of modified source face and the at least one further face is replaced with the modified further source face to generate a personalized video. The personalized video is sent to at least one further user.

Growing community of inventors

Sochi, Russia

Alexander Mashrabov