Cisco Technology, Inc.

Walter Friedrich

Shantanu Sarkar

Duanpei Wu

Nermin M Ismail

Luke K Surazski

Keith A Lantz

Scott S Firestone

Thiyagesan Ramalingam

Steven G Fry

Wen-hsiung Chen

Fang Wu

Francis Paul Viggiano

Disclosed are video conferencing systems, devices, architectures, and methods for transcoding, transrating, and the like, to facilitate video streaming in a distributed arrangement. An exemplary translator in accordance with embodiments can include: an input configured to receive a first video stream in a first format, the first video stream being from a first media switch, the first media switch being associated with a first stream group having one or more first endpoints; and an output configured to provide a second video stream in a second format, the second video stream being sent to a second media switch, the second media switch being associated with a second stream group having one or more second endpoints, whereby the translator is configured to convert from the first to the second format. Further, the translator can be configured as a logical endpoint where a first interface having an input/output pair uses the first format and a second interface having another input/output pair uses the second format. The two formats may differ in at least one characteristic.

Method and apparatus for transcoding and transrating in distributed video systems

A method for executing a video conference is provided that includes receiving one or more audio streams associated with a video conference from one or more end points and determining an active speaker associated with one of the end points. Audio information associated with the active speaker may be received at one or more media switches. One or more video streams may be suppressed except for a selected video stream associated with the active speaker, the selected video stream propagating to one or more of the media switches during the video conference. The selected video stream may be replicated such that it may be communicated to one or more of the end points associated with a selected one of the media switches.

System and method for performing distributed video conferencing

A method, an apparatus and a medium encoded with instructions for providing layout selection, participant selection, and/or participant-to-participant far end camera control of the selected participant for use in a continuous presence multipoint videoconference. The method includes receiving one or more far end camera control messages over a packet network from a first participant of a multipoint videoconference; maintaining an indication of a far end camera control mode for the first participant, the mode being one of a set of modes; and depending on the far end camera control mode and on controls possible, carrying out a control according to one ore more the camera control messages.

Method and apparatus for using far end camera control (FECC) messages to implement participant and layout selection in a multipoint videoconference

Disclosed are video conferencing systems, devices, architectures, and methods for using media notifications to coordinate switching between video in a distributed arrangement. An exemplary media switch in accordance with embodiments can include: a first interface configured for a first type communication with an endpoint; a second interface configured for the first type communication with another media switch, the second interface being configured to receive a first video stream having a first characteristic and a second video stream having a second characteristic; a third interface configured for a second type communication with a stream controller, the stream controller being configured to provide a notification; and a fourth interface configured for the second type communication with a controlling server, whereby the media switch is configured to re-target an active stream in response to the notification or a difference between the first and second characteristics.

Method and architecture for distributed video switching using media notifications

Marking a keyframe of a media stream in a communication system involves one or more entry media switches in communication with one or more endpoints. An entry media switch receives a media stream from an endpoint, where the media stream comprises a sequence of packets with a keyframe. The keyframe is detected and marked with a keyframe indicator. The keyframe indicator is operable to notify a downstream device of the keyframe. An output media stream is outputted.

Marking keyframes for a communication session

Synchronizing audio and video streams in packet-based networks requires synchronization of packet timestamps. The present invention provides such synchronization without resort to a network time standard. In one embodiment of the present invention, pairs of timestamp synchronized signals, such as audio and video signals, not having a common timestamp clock are mixed. One of the signals, for example, the audio signals, is mixed first while preserving the original audio timestamps. The preserved timestamp information is then used to synchronize the timestamps of the unmixed signals, in this example the video signals, to provide synchronization of all signals. In another embodiment, the present invention uses packets containing calibration of timestamps to reduce jitter. The present invention also includes specifications for a packet for transmitting timestamp information.

Audio-to-video synchronization system and method for packet-based network video conferencing

Providing a conference call includes establishing a bidirectional first class stream for each of a set of first class endpoints. A second class stream is established for each of a set of second class endpoints. Mixed streams are generated using the bidirectional first class streams, and one or more mixed streams are broadcasted to the set of second class endpoints. A particular second class endpoint is determined to have a right to have its stream included in the mixed streams. The second class stream for the particular second class endpoint is mapped to a bidirectional second class stream for the particular second class endpoint. Next mixed streams are generated using the bidirectional second class stream.

Scalable moderated audio conferencing for multicast and unicast endpoints and gateways

A method and an apparatus for providing layout selection, participant selection, and/or participant-to-participant far end camera control of the selected participant for use in a continuous presence multipoint videoconference. The method includes receiving an FECC message of a set of FECC messages over a packet network from a first participant, the first participant having a set of FEEC modes and being in one of the FECC modes. The method further includes maintaining knowledge of the mode of the first participant and interpreting the received FECC message according to the FECC mode of the first participant. Depending on the FECC mode of the first participant, the interpreted FECC message, and the set of controls provided by the method (layout selection and/or participant selection to select a participant and/or participant-to-participant camera control), the method further includes one of changing the FECC mode of the first participant, forming a layout for the first participant, selecting a participant for the first participant, or carrying out participant-to-participant camera control of a previously selected participant.

An audio mixer on a first device receives one or more incoming audio streams. Each of the one or more incoming audio streams has an associated timestamp. The audio mixer generates a mixed audio stream from the one or more incoming audio streams. The audio mixer determines differences in the time base of each of the one or more incoming audio streams and the time base for the mixed audio stream. The audio mixer generates mapping parameters associated with the determined differences and transforms the timestamp of each of the one or more incoming audio streams to a corresponding output timestamp associated with the mixed audio stream according to the mapping parameters. the mapping parameters are provided to a video mixer for similar processing and transformation such that the mixed audio stream is in synchronization with a mixed video stream.

Growing community of inventors

Pleasanton, CA, United States of America

Walter Friedrich