Zoom Video Communications, Inc.

Zoom Communications, Inc.

Tcl Research America Inc.

Xiaoli Song

Haohong Wang

Tao Huang

Hui Wen

Melinda Min Xiao-Devins

Fangyi Zhao

Ran Yan

Davide Giovanardi

Min Xiao-Devins

Stephen Muchovej

Vijay Parthasarathy

Yue Shang

Mengxiao Qian

Helgi Hilmarsson

Lifan Guo

Dingping Jiang

Junqing Wang

Mengwen Liu

Chuan Qin

Wanying Ding

Peng Su

Hongjuan Wang

Hao Huang

Shaoyang Wu

Yaling Song

Dan Hu

Shuo Luo

Juhua Ma

Hsin-Tai Wu

Facheng Wang

Weilun Cheng

Qingquan Xie

Wan Chen

Methods and systems provide for extracting engaging questions from a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants produced during the communication session; extracts, from the transcript, utterances including one or more sentences spoken by the participants; identifies a subset of the utterances spoken by a subset of the participants associated with a prespecified organization; extracts engaging questions within the subset of utterances, the engaging questions each including a question asked by the participant associated with the organization that is immediately answered in the following utterance by a participant not associated with the organization; and presents, for display at one or more client devices, data corresponding to the extracted engaging questions.

Extracting engaging questions from a communication session

Methods and systems provide for presenting the results of talking speed analysis per topic segment in a communication session. The system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for each utterance of a speaking participant; determines, based on analysis of the transcript, a meeting type for the communication session; generates, based on the meeting type, a number of topic segments for the conversation and respective timestamps for the topic segments; for each topic segment, determines a word count per unit of time for each speaking participant associated with a prespecified organization; and presents, to one or more client devices, data on the topic segments, each data including the word count per unit of time for each speaking participant within the topic segment.

Talking speed analysis per topic segment in a communication session

A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. Scores are determined for strings of the transcript that are used to select strings for inclusion in the conference summary. Determining the scores includes determining respective sentence vectors for strings. A sentence vector has elements corresponding to words in the transcript that are proportional to occurrences of the word in the string and inversely proportional to occurrences of the word in the transcript. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of conference information within a unified communications system.

Automated recording highlights for conferences

Methods and systems provide for dynamic conversation alerts within a communication session. In one embodiment, the system presents, to a client device associated with a user of a communication platform, a user interface ('UI') including a prompt for the user to submit one or more alert phrases, each alert phrase being associated with a category; receives, from the client device, a list of submitted alert phrases; and receives a transcript of a communication session between participants. For each utterance in the transcript, the system determines whether one or more predictions of relatedness are present between the utterance and one or more alert phrases from the list of submitted alert phrases. The system then transmits, to the client device, a list of related categories, each related category including one or more timestamps of utterances for which a prediction of relatedness is present for an alert phrase associated with that category.

Dynamic conversation alerts within a communication session

Methods and systems provide for dynamically generated topic segments for a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a list of topics; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for a number of utterances associated with speaking participants; for each topic in the list of topics, segments the utterances into one or more topic segments based on the topic; for each of the segments, classifies whether the topic segment is related to the topic, and transmits, to one or more client devices, a list of the topic segments for the communication session.

Dynamic communication session topic generation

Methods and systems provide for intelligent content recommendation within a communication session. In one embodiment, the system receives a list of content recommendation actions, each content recommendation action being associated with one or more trigger phrases constituting conditions for the content recommendation action to be performed, each trigger phrase being associated with a party the trigger phrase is to be uttered by. The system connects to a communication session with a plurality of participants, and receives a number of utterances associated with the participants in real time. For each utterance, the system determines whether a prediction of relatedness is present between the utterance and one or more trigger phrases associated with a content recommendation action. Upon determining that a prediction of relatedness is present, the system performs the associated content recommendation action by transmitting, to one or more client devices, one or more pieces of content to be recommended.

Intelligent content recommendation within a communication session

A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.

Conference summary generation

Dynamically generated topic segments for a communication session

A transcript of a conference is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.

Speaker segment analysis for conferences

A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A graphical user interface is presented that enables a user to edit highlighting to select portions of a conference recording for inclusion in the conference summary. The user can edit highlighting on strings of a transcript and/or on a playback slide bar and the highlighting edits are propagated to both of these interfaces. Video clips selected for inclusion in a summary based on timestamps of strings in a transcript may be extended forward in time to incorporate a nearest I-frame of video. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.

A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) in the transcript that have been selected for highlighting as part of the conference summary. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.

A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments&#x2014;sequences of consecutive strings attributed to the same speaker&#x2014;are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.

A method for scalable user intent mining is provided. The method includes detecting named entities from a plurality of query logs in a public query log dataset and generating features of the plurality of query logs based on the detected named entities. The method also includes applying a multimodal restricted boltzmann machine (RBM) on the generated features of the plurality of query logs to train a public multimodal RBM and generating a plurality of public query representations. Further, the method includes receiving a search query from a user, determining whether there are a plurality of history queries of the user. When there is no history query, user intent is predicted using the public multimodal RBM. When there are the history queries, the public multimodal RBM is applied on the plurality of history queries to train a personalized multimodal RBM, and the user intent is predicted using the personalized multimodal RBM.

Scalable user intent mining using a multimodal restricted boltzmann machine

A method is provided for recommending a desired func sequence to a user. The method includes obtaining a user intention list including at least one user intention; separating the user intention into a plurality of tasks; and creating a task flow graph for the plurality of tasks based on user usage data. Each vertex in the task flow graph represents a task and indicating an importance of the task. The method also includes creating a func flow graph based on the user usage data and temporal sequences of the tasks and funcs, and each vertex in the func flow graph represents a func and indicating an importance of the func. Further, the method includes determining a desired func sequence to fulfill the user intention based on the user usage data, the task flow graph, and the func flow graph; and recommending the desired func sequence to the user.

Growing community of inventors

Sunnyvale, CA, United States of America

Xiaoli Song