Facebook, Inc.

Microsoft Technology Licensing, LLC

Meta Platforms, Inc.

Stephane Taine

Brendan Benjamin Aronoff

Jason Duane Clark

Duckjin Kang

Michael Leggett

Peter Henry Martinazzi

Zhengping Zuo

Dwayne B Mercredi

Edward Young Zhang

John Randall Ehrhardt

Evan Patrick Noon

Krishnamurthy Ganesan

Ewa Dominowska

Ahmad Abdulmageed Mohammed Abdulkader

Vladislav Belous

Seyed Mohsen Amiri

Timothy Mark Moore

Li Zhou

Shyamalan Pather

Goran Predovic

Deepak Rao

Liang Xu

Srivatsa K Srinivasan

Nora Micheva

Brian Scott Stucker

Li Hua

Michelle Ruby Hwang

Vivek Garg

Ajay Kumar Soni

Ganesh Sridharan

Joel Alexander Bullard

Yi Huang

Andreas Strebel

Anne Raynor

Loren William Abrams

Joshua Gordon Selbo

Shahzaib Younis

Hoang Le

Candace Button Disco

Joseph Stephen Gonzalez

Jonathan Kenn Lewis

Shiladitya Bandyopadhyay

Jiawei Ou

Kurt K De Ding

Kelly Nicole Stevens

Johnathan Harms

Alex Edelsburg

An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.

Customized graphics for video conversations

In one embodiment, a method includes launching, by a client system of a first user, a video-call session to enable a video stream for display in a small-overlay-window on a display of the client system of the first user; receiving, by the client system of the first user, a video stream comprising video from a client system of a second user; determining at least one property for the small-overlay-window based on information associated with the second user; and displaying the video stream in the small-overlay-window, wherein the small-overlay-window is customized based on the determined at least one property, and wherein the small-overlay-window is positioned directly over an interface of an active application running on the client system of the first user.

Non-disruptive display of video streams on a client system

Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common 'watch together' experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.

Messenger MSQRD&#x2014;mask indexing

Exemplary embodiments relate to techniques for sharing live video while maintaining an asynchronous copy of the video. According to some embodiments, a user begins to record video and shares the video with selected other users. If one of the other users opts to join the original user, the shared video upgrades to a live video conversation. If no one (or only some participants) joins the original user, the recorded video becomes an asynchronous artifact in the users' messaging history. In some embodiments, the live video may be recorded and shared in response to a first user initiating a video call with at least a second user, but receiving no answer. The first user begins to share a live video (which may become an asynchronous artifact). If the second user joins the call while the video is being recorded, the conversation may upgraded to a video conversation.

Methods and systems for transmitting a video as an asynchronous artifact

An online system using attributes of users to select content for presentation to the users predicts one or more attributes of users whose attributes are unavailable to the online system. For a user with one or more attributes unavailable to the online system, the online system applies a model to attributes of additional users to predict one or more attributes of the user. Attributes of the additional user use in the prediction may include demographic information and interactions with content by the additional users. The online system may determine an accuracy of the model by using the model to predict attributes for users whose attributes are known to the online system and comparing the predicted attributes to the known attributes. If the model's accuracy is less than a threshold value, the online system discontinues using the model to predict attributes of users.

Predicting demographic information of an online system user based on online system login status

Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.

Media effect application

In one embodiment, a method includes determining, by a computer server machine, that a callee-user is available for a communication session based on location information associated with a client system of the callee-user; sending, by the computer server machine, in response to determining that the callee-user is available, a notification to a client system of a caller-user indicating that the callee-user is available; receiving, by the computer server machine, a request from the client system of the caller-user to initiate the communication session; establishing, by the computer server machine, the communication session to enable a media stream comprising media captured at the client system of the caller-user to be received at the client system of a callee-user; and sending, by the computer server machine, the media captured at the client system of the caller-user to the client system of the callee-user.

Instantaneous call sessions over a communications application

Methods and systems for tracking media effects in a media effect index

Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).

Face detection for video calls

Exemplary embodiments relate to techniques for facilitating a connection between two users in a call by providing an 'answering window' when a user calls. When a caller places a call to a callee, the call invitation may remain open for a window of time during which the caller remains available. The callee may opt to answer the call at any time during the window. During the window, the caller may be placed in a lobby and may share audio and/or video. Accepting the call during the answering window may place the callee in the lobby or may directly convert the interaction into an active call. The callee may request that the window can be altered, or may signal their intention to answer the call at a particular time.

Methods and systems for connecting caller and callee client devices

This disclosure covers methods, non-transitory computer readable media, and systems that analyze a previously unrecognized communication number associated with a sender of a direct digital message when a client device receives the direct digital message from the previously unrecognized communication number. Based on this analysis, the methods, non-transitory computer readable media, and systems provide profile information associated with the communication number for the client device to present together with the direct digital message. To find relevant profile information for the communication number, the disclosed methods, non-transitory computer readable media, and systems optionally query a social networking system for profile information connected to the communication number.

Identifying profile information of senders of direct digital messages

In one embodiment, a method includes sending an availability-notification a caller-user in response to an occurrence of a trigger event; establishing a call session to enable a media stream comprising media of the caller-user that is of a first type to be received by a callee-user; sending the media of the first media type to the callee-user; re-establishing the call session to enable a media stream comprising media of the callee-user that is of a second media type to be received by the caller-user; and sending the media of the second media type to the caller-user.

Messenger MSQRD-mask indexing

Growing community of inventors

Issaquah, WA, United States of America

Stephane Taine