Facebook, Inc.

Meta Platforms, Inc.

Brendan Benjamin Aronoff

Stephane Taine

Jason Duane Clark

Duckjin Kang

Peter Henry Martinazzi

Zhengping Zuo

Dwayne B Mercredi

Edward Young Zhang

John Randall Ehrhardt

Michael Leggett

Evan Patrick Noon

Ryan Michael O'Rourke

Rishi Pankaj Mody

Christian Xavier Dalonzo

Shannon M Ma

William Samuel Bailey

Sharon Zeng

Qikun Guo

Mark Evan Davis

An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.

Customized graphics for video conversations

Methods, systems, and storage media for video navigation normalized by relevance are disclosed. Exemplary implementations may: obtain a plurality of videos recorded in a chronological order; stitch the plurality of videos together in a timeline based on the chronological order, the timeline comprising a visual menu; obtain information associated with the plurality of videos; determine, based on a measure of relevance, a ranking of videos among the plurality of videos; determine, based on the ranking of videos, one or more salient videos from among the plurality of videos, the one or more salient videos comprising a video that is within a range of the ranking of videos; obtain one or more representations associated with individual ones of the one or more salient videos; and cause display of the one or more representations in the timeline, the representations being arranged based at least in part on the chronological order.

Video navigation normalized by relevance

Display screen with a graphical user interface

Systems and techniques are described that enable users to capture and share content through a social network application and/or service with other users. A device associated with a first account may display a camera capture interface including a control associated with a second account and may receive a selection of the control associated with the second account. The device may capture content responsive to the selection and present a preview screen of captured content. The device may receive an indication (e.g., a swipe gesture, selection of a send control, etc.) to perform an action with respect to the captured content, such as sending the captured content to the second account.

Social network interactions

In one embodiment, a method includes launching, by a client system of a first user, a video-call session to enable a video stream for display in a small-overlay-window on a display of the client system of the first user; receiving, by the client system of the first user, a video stream comprising video from a client system of a second user; determining at least one property for the small-overlay-window based on information associated with the second user; and displaying the video stream in the small-overlay-window, wherein the small-overlay-window is customized based on the determined at least one property, and wherein the small-overlay-window is positioned directly over an interface of an active application running on the client system of the first user.

Non-disruptive display of video streams on a client system

Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common 'watch together' experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.

Messenger MSQRD&#x2014;mask indexing

Exemplary embodiments relate to techniques for sharing live video while maintaining an asynchronous copy of the video. According to some embodiments, a user begins to record video and shares the video with selected other users. If one of the other users opts to join the original user, the shared video upgrades to a live video conversation. If no one (or only some participants) joins the original user, the recorded video becomes an asynchronous artifact in the users' messaging history. In some embodiments, the live video may be recorded and shared in response to a first user initiating a video call with at least a second user, but receiving no answer. The first user begins to share a live video (which may become an asynchronous artifact). If the second user joins the call while the video is being recorded, the conversation may upgraded to a video conversation.

Methods and systems for transmitting a video as an asynchronous artifact

Exemplary embodiments relate to techniques for creating drawings in communications applications. When the system registers a sustained haptic contact signal, further contacts may generate drawings to be overlaid onto a message thread. While the contact is sustained, each swipe may create a new stroke that is transmitted on a real-time data channel. A new layer may be defined over the messages, having its own coordinate system. The drawing may be recreated on the recipient client by drawing the strokes on the new layer. Each participant may see the drawing displayed over their message thread. The drawing may scroll with the messages, or may be displayed in the same place on the screen until cleared by some action from the sender or recipient.

Methods and systems for defining and transmitting a drawing stroke

Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.

Media effect application

In one embodiment, a method includes determining, by a computer server machine, that a callee-user is available for a communication session based on location information associated with a client system of the callee-user; sending, by the computer server machine, in response to determining that the callee-user is available, a notification to a client system of a caller-user indicating that the callee-user is available; receiving, by the computer server machine, a request from the client system of the caller-user to initiate the communication session; establishing, by the computer server machine, the communication session to enable a media stream comprising media captured at the client system of the caller-user to be received at the client system of a callee-user; and sending, by the computer server machine, the media captured at the client system of the caller-user to the client system of the callee-user.

Instantaneous call sessions over a communications application

Methods and systems for tracking media effects in a media effect index

Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).

Face detection for video calls

Exemplary embodiments relate to techniques for facilitating a connection between two users in a call by providing an 'answering window' when a user calls. When a caller places a call to a callee, the call invitation may remain open for a window of time during which the caller remains available. The callee may opt to answer the call at any time during the window. During the window, the caller may be placed in a lobby and may share audio and/or video. Accepting the call during the answering window may place the callee in the lobby or may directly convert the interaction into an active call. The callee may request that the window can be altered, or may signal their intention to answer the call at a particular time.

Growing community of inventors

San Francisco, CA, United States of America

Brendan Benjamin Aronoff