Zoom Communications, Inc.

Zoom Video Communications, Inc.

Ling Tsou

Renjie Tao

Tong Wang

Yun Zhang

Andrew Miller-Smith

Junqing Wang

Peng Su

Methods and systems provide title detection for presented slides. In one embodiment, the system receives video content of a communication session with a number of participants; extracts frames from the video content; classifies the frames of the video content; identifies one or more distinguishing frames containing a presentation slide; for each distinguishing frame containing a presentation slide, detects a title within the frame; and transmits, to one or more client devices, the titles for each of the distinguishing frames comprising a presentation slide.

Detection of titles in presentation slides of a communication session

Methods and systems provide for dynamic prediction of agenda item coverage in a communication session. In one embodiment, the system classifies each agenda item as a long item or a short item; for agenda items classified as long items, extracts one or more topics from the utterances, and uses a topic detection model to predict whether a topic related to each agenda item classified as a long item has been covered; for agenda items classified as short items, applies one or more matching methods to predict whether one or more of the utterances within the sentence threshold cover each agenda item classified as a short item; and transmits, to one or more client devices, a status of the agenda items for the communication session.

Dynamic agenda item coverage prediction

Methods and systems provide for providing extraction of textual content from video of a communication session. In one embodiment, the system receives video content of a communication session which includes a number of participants. The system then extracts frames from the video content, and classifies the frames of the video content. The system identifies one or more distinguishing frames containing text. For each distinguishing frame containing text, the system detects a title within the frame, crops a title area with the title within the frame, and extracts, via optical character recognition ('OCR'), the title from the cropped title area of the frame. The system extracts, via OCR, textual content from the distinguishing frames containing text, and then transmits the extracted textual content and extracted titles to one or more client devices.

Extraction of textual content from video of a communication session

Methods and systems provide for providing video frame type classification in a communication session. In one embodiment, the system receives video content of a communication session with a number of participants; extracts frames from the video content; classifies the frames of the video content based on image analysis; and transmits, to one or more client devices, the classification of the frames of the video content.

Video frame type classification for a communication session

Methods and systems provide for providing intelligent topic segmentation within a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for a number of utterances associated with speaking participants; shifts a window over the utterances to generate blocks of utterances; for each shift of the window over one utterance, identifies topic model ('TM') clusters (hereinafter “TM clusters”) and generates TM cluster scores to assign text labels for each cluster; aggregates the scores for the TM clusters to generate a number of utterance level scores; converts the utterance level scores into topic segments each including a start time, end time, and associated text label; and transmits, to one or more client devices, a list of the topic segments for the communication session.

Intelligent topic segmentation within a communication session

Methods and systems provide for search results within segmented communication session content. In one embodiment, the system receives a transcript and video content of a communication session between participants, the transcript including timestamps for a number of utterances associated with speaking participants; processes the video content to extract textual content visible within the frames of the video content; segments frames of the video content into a number of contiguous topic segments; determines a title for each topic segment; assigns a category label for each topic segment; receives a request from a user to search for specified text within the video content; determines one or more titles or category labels for which a prediction of relatedness with the specified text is present; and presents content from at least one topic segment associated with the one or more titles or category labels for which a prediction of relatedness is present.

Searching within segmented communication session content

Methods and systems provide for dynamic prediction of agenda item coverage in a communication session. In one embodiment, the system connects to a communication session with a plurality of participants; receives one or more agenda items and a number of utterances; classifies each agenda item as a long item or a short item; for agenda items classified as long items, extracts one or more topics from the utterances, and uses a topic detection model to predict whether a topic related to each agenda item classified as a long item has been covered; for agenda items classified as short items, applies one or more matching methods to predict whether one or more of the utterances within the sentence threshold cover each agenda item classified as a short item; and transmits, to one or more client devices, a status of the agenda items for the communication session.

Growing community of inventors

Los Angeles, CA, United States of America

Ling Tsou