Zoom Video Communications, Inc.

Zoom Communications, Inc.

Fortemedia, Inc.

Other

Chi-Chian Yu

Jeffrey William Smith

Ming Zhang

Cynthia Eshiuan Lee

Shane Paul Springer

Tseng Jan Hsu

Dennis Paul Rubery

Anthony Bao Quoc Hoang

Frame rates for rendering video streams depicting conference participants within a physical space are adjusted based on motion detected with respect to those conference participants. Regions of interest are identified within an initial video stream captured by a video capture device. The video capture device is caused to capture, at an initial frame rate, video streams each associated with a different one of the regions of interest. An adjusted frame rate for a region of interest of the regions of interest is determined based on information associated with content depicted within the region of interest. A frame rate of a video stream of the video streams is then adjusted from the initial frame rate to the adjusted frame rate, in which the video stream is associated with the region of interest.

Region of interest-based frame rate adjustment

A client application associated with a communications system may connect to a video conference. During the video conference, a decrease in a quality associated with an audio output generated by the communications system may be detected. In response to detecting that the quality associated with the audio output has decreased, a change to the communications system may be determined to increase the quality associated with the audio output. The change may be applied to the communications system to increase the quality of further audio output generated by the communications system during the video conference.

Increasing quality associated with an audio output during a video conference

A conference room device located in a conference room uses a conference room microphone to capture audio for one or more in-person conference participants located in the conference room during a conference. During the conference, audio is sampled from the microphone used by the conference room device and from microphones of one or more user devices determined to be located in the conference room. Based on a score calculated for the audio sampled from a user device being higher than a score calculated for audio sampled from the conference room device, the microphone of the user device is selected for audio capture for one or more of the in-person conference participants. The audio is output through conferencing software to which the conference room device is connected via a user interface tile for the conference room without displaying a new user interface tile.

Audio capture device selection for in-person conference participants

A conference gallery view intelligence system determines regions of interest for display within views of conferencing software based on input streams received from devices within a conference room during a conference. Conference participants are detected in the conference room based on an input video stream received from a video capture device. A direction of audio from the conference participants is determined based on an input audio stream received from a multi-directional audio capture device. A conversational context within the conference room is then determined based on the direction of the audio and locations of the one or more conference participants in the conference room. A region of interest to output within conferencing software is determined based on the conversational context, and the region of interest is output for display within a view of the conferencing software.

Changing conference outputs based on conversational context

Systems and methods for aggregation and distribution of diverse multimedia feeds are provided herein. In an aspect, a method including establishing, by a video conference provider, a virtual meeting having a plurality of participants is provided. Each participant joined to the virtual meeting may use a respective client device to exchange one or more audio or video streams via the virtual meeting. The method may also include receiving, from a first client device, a request to share a multimedia stream from an external source with one or more of the client devices during the virtual meeting. Responsive to the request, the method may include receiving a connection to the multimedia stream from the external source and transmitting, by the video conference provider, the multimedia stream from the external source to the one or more client devices via the virtual meeting.

Aggregation and distribution of diverse multimedia feeds

Aspect ratios used to display video streams within a graphical user interface (GUI) of a video conference are dynamically adjusted based on events detected during the video conference. According to one approach, during a video conference between a first device and a second device, a first video stream from the first device and a second video stream from the second device are both displayed within the GUI using an initial aspect ratio. Based on the first video stream, an event corresponding to a change in a number of people participating in the video conference from the first device is determined. Based on the event, an adjusted aspect ratio to use for displaying the first video stream within the GUI is determined. The first video stream is displayed within the GUI using the adjusted aspect ratio while the second video stream remains displayed within the GUI using the initial aspect ratio.

Dynamic aspect ratio adjustment during video conferencing

Normalized resolutions are determined for first and second regions of interest of an initial video stream captured by a video capture device located within a physical space. The first region of interest is associated with a first conference participant within the physical space and the second region of interest is associated with a second conference participant within the physical space. Instructions are transmitted to the video capture device to cause the video capture device to capture, at the normalized resolutions, a first video stream associated with the first region of interest and a second video stream associated with the second region of interest. The first and second video streams conform sizes and quality levels of the first and second conference participants within separate user interface tiles of a conferencing software user interface to which the first and second video streams are output.

Normalized resolution determination for multiple video stream capture

A microphone of a primary client device is used to capture audio for a remote conference participant. During the conference, audio is sampled from the microphone of the primary client device and from microphones of one or more secondary client devices at the same location as the primary client device. Based on a score calculated for the audio sampled from the secondary client device being higher than a score calculated for audio sampled from the primary client device, the microphone of the secondary client device is selected for audio capture for the remote conference participant. The audio is output through conferencing software to which the primary client device is connected via a user interface tile for the conference without displaying a new user interface tile.

Audio capture device selection

A conference gallery view intelligence system determines at least two regions of interest within a conference room based on an input video stream received from a video capture device located within the conference room. An output video stream for rendering within conferencing software is produced for each of the at least two regions of interest. The output video stream for each of the at least two regions of interest is then transmitted to one or more client devices connected to the conferencing software.

Conference gallery view intelligence system

During a conference, a first video stream is obtained from a first participant device connected to a local area network and a second video stream is obtained from a second participant device connected to the local area network. A first frame rate is determined for the first participant device to use based on information particular to the first video stream and based on a network constraint associated with the local area network. A second frame rate is determined for the second participant device to use based on information particular to the second video stream and based on the network constraint associated with the local area network. The first participant device and the second participant device are then instructed, during the conference, to respectively capture the first video stream at the first frame rate and the second video stream at the second frame rate.

Motion-based frame rate adjustment for network-connected conference participants

A video capture device within a physical space captures an initial video stream of first and second conference participants within the physical space. Data indicative of first and second regions of interest of the initial video stream are transmitted to a computing device. The first and second regions of interest are respectively associated with the first and second conference participants. First and second video streams associated with the first and second regions of interest are captured at normalized resolutions according to instructions received from the computing device. The first and second video streams are transmitted for output within separate user interface tiles of a conferencing software user interface. The first and second video streams conform sizes and quality levels of the first and second conference participants respectively within first and second user interface tiles of the conferencing software user interface.

Concurrent region of interest-based video stream capture at normalized resolutions

User interface (UI) tiles of conference participants are arranged in a UI of conferencing software according to relative locations of those conference participants within a conference room. Positional information and video data are obtained from one or more video capture devices located within a conference room. Relative locations of conference participants within the conference room are determined based on the positional information, such as by defining coordinates for the conference participants within a coordinate system based on the positional information and the video data and determining the relative locations based on the coordinates. Output configured to cause a client application to arrange UI tiles associated with the conference participants is generated according to the relative locations. The output is then transmitted to one or more client devices to cause a UI of conferencing software at each of those client devices to display the UI tiles in the specified arrangement.

User interface tile arrangement based on relative locations of conference participants

Audio capture device selection for remote conference participants

First and second regions of interest are be identified within an initial video stream captured by a video capture device located within a physical space, in which the first region of interest is associated with a first conference participant within the physical space and the second region of interest is associated with a second conference participant within the physical space. A first frame rate may be determined for the first region of interest based on information associated with the first conference participant, and a second frame rate may be determined for the second region of interest based on information associated with the second conference participant. A capture of a first video stream associated with the first region of interest at the first frame rate and a second video stream associated with the second region of interest at the second frame rate may then be caused.

Growing community of inventors

San Ramon, CA, United States of America

Chi-Chian Yu