Other

Realnetworks Gmbh

Vivo Software, Inc.

Massachusetts Institute of Technology

Picturetel Corporation

8.times.8, Inc.

Netergy Microelectronics, Inc.

Netergy Networks, Inc.

Netergu Networks

Bernd Girod

Staffan Ericsson

Thomas Wiegand

Jeffrey G Bernstein

Edward H Adelson

Xiancheng Yuan

Richard L Baker

Edmund S Thompson

Nikolaus Farber

Nikolaus F&auml;rber

Yuriy A Resnik

Yuriy A Resznik

Markus Flierl

John Bruder

Frank H Hartung

A method for generating a digital motion video sequence at a plurality of bit rates uses a transitional coding source when switching between bitstreams having different bit rates during transmission of a video sequence. The transitional data may be frames coded using reconstructed frames reconstructed for a first bitstream using the characteristics of the second bitstream. These 'low bit rate insert frames,' or LBIFs, contain the image characteristics of a signal coded at the lower bit rate. With a bitstream having a higher bit rate being periodically coded using an LBIF, a point of image continuity between the two bitstreams is provided. Thus, switching from one bitstream to the other at this point in the video sequence minimizes the production of artifacts caused by differences in bit rate. In another embodiment of the invention, a separate set of transitional data is created, taking the form of 'switch' frames, or S-frames. The S-frames are typically the difference between a frame of a first bitstream and a frame of a second bitstream. These frames are inserted into the decoded bitstream during the transition from one bitstream to the other, and compensate for any visual artifacts that might otherwise occur due to the difference in bit rate of the two bitstreams.

Method and apparatus for providing scalable pre-compressed digital video with reduced quantization based artifacts

Video images are communicated between two stations using a method for predicting motion uses up to N frames of the video data, where N is a positive integer and each frame is represented as a plurality of image segments. According to one implementation, combined are at least two spatial displaced image segments from previously decoded frames corresponding to time instances on one side of a temporal axis; and the video data is communicated using the spatial displaced image segments along with corresponding delays as side information. Other aspects of the disclosure include combining using a Lagrangian cost function, and an iterative search method to minimize Lagrangian cost function.

Multi-hypothesis motion-compensated video image predictor

A wireless user-interface method and arrangement having a light source and a circuit arrangement that detects the presence and position of the light source. A light source emits modulated light having a first modulation frequency that is captured by a camera circuit arrangement. A circuit arrangement uses relative pixel luminances and differences in pixel luminances between frames to detect the presence of modulated light from the light source. The position of the light source is tracked from frame to frame and the position information is output for use by application software or circuitry to direct movement of a pointer in a computer display, for example. Modulated light having a second modulation frequency from the light source is detected by the circuit arrangement and interpreted as selection of a control function, which is provided as output to application software or circuitry. The application uses the position of the light source along with control signals to identify an operation to perform.

Wireless user-interface arrangement and method

Coding and decoding of video images includes the use of multiple reference pictures and determining motion vector and time delay information for the video images. Video images are quantized and transmitted with the motion vector and time delay information from a first station to a second station. A new video image is predicted for display at the second station as function of the motion parameter codes and multiple reference pictures. The invention may be used in connection with a video communication and/or video conferencing system as a long-term memory predictor to improve image-coding efficiencies and motion compensation. The long-term memory prediction extends the spatial displacement utilized in block-based hybrid video coding by a variable time delay. The arrangement and method employ a proposed bit allocation scheme to provide increased coding efficiencies of the video coder. Applications include video reproduction of repetitive sequences, such as when the video camera is shaking or an image portion is repetitively moving between previously-displayed positions.

Video coder/decoder

A circuit arrangement for controlling audio signal transmissions for a communications system that includes a microphone and a video camera. The arrangement comprises a video processor configured and arranged to receive a video signal from the video camera, detect movement of an object in the video signal, and provide a motion-indicating signal indicating movement relative to the object. An audio processor is coupled to the video processor and is configured and arranged to modify the audio signal to be transmitted responsive to the motion-indicating signal. In another embodiment, a video signal processor is configured and arranged to receive a video signal from the video camera, detect mouth movement of a person and provide a mouth-movement signal indicative of movement of the person's mouth. An echo-cancellation circuit is coupled to the video signal processor and configured and arranged to filter from an audio signal provided by the microphone sound energy output by the speaker responsive to the mouth-movement signal.

Video-assisted audio signal processing system and method

A method for generating a digital motion video sequence at a plurality of bit rates uses a transitional coding source when switching between bitstreams having different bit rates during transmission of a video sequence. The transitional data may be frames coded using reconstructed frames reconstructed for a first bitstream using the characteristics of the second bitstream. These &ldquo;low bit rate insert frames,&rdquo; or LBIFs, contain the image characteristics of a signal coded at the lower bit rate. With a bitstream having a higher bit rate being periodically coded using an LBIF, a point of image continuity between the two bitstreams is provided. Thus, switching from one bitstream to the other at this point in the video sequence minimizes the production of artifacts caused by differences in bit rate. In another embodiment of the invention, a separate set of transitional data is created, taking the form of &ldquo;switch&rdquo; frames, or S-frames. The S-frames are typically the difference between a frame of a first bitstream and a frame of a second bitstream. These frames are inserted into the decoded bitstream during the transition from one bitstream to the other, and compensate for any visual artifacts that might otherwise occur due to the difference in bit rate of the two bitstreams.

Video coding/decoding arrangement and method therefor

A variable length coding system encodes and decodes symbols as uniquely decodable code words using an assignment scheme having a maximum code word length. According to one embodiment, a first bitstream is combined with a second bitstream to provide a resultant bitstream to be sent over a communications channel. The first bitstream represents the code words in a forward direction, and the second bitstream contains the same code words reversed and bit delayed by at least the maximum code word length. A resultant bitstream can be decoded in forward or reverse direction. The scheme is highly efficient for long blocks of data and the reversible aspect of the coding scheme improves the tolerance for errors caused by channel interference.

Data communication arrangement having variable length coding and method therefor

Coding and decoding of video images includes the use of multiple reference pictures and determining motion vector and time delay information for the video images. Video images are quantized and transmitted with the motion vector and time delay information from a first station to a second station. A new video image is predicted for display at the second station as function of the motion parameter codes and multiple reference pictures. The invention may be used in connection with a video communication and/or video conferencing system as a long-term memory predictor to improve image-coding efficiencies and motion compensation. The long-term memory prediction extends the spacial displacement utilized in block-based hybrid video coding by a variable time delay. The arrangement and method employ a proposed bit allocation scheme to provide increased coding efficiencies of the video coder. Applications include video reproduction of repetitive sequences, such as when the video camera is shaking or an image portion is repetitively moving between previously-displayed positions.

A method is provided for performing a fast Discrete Cosine Transform (DCT) and a fast Inverse Discrete Cosine Transform (IDCT) in a software implementation. The method provided exploits symmetries found in both the DCT and IDCT. As a result of the symmetries found in the DCT and IDCT, both transforms may be performed using a combination of look-up tables and butterfly operations, thus employing only a small number of additions and subtractions and no multiplications. Furthermore, there is provided an aspect of the present invention which exploits the excess precision available in current central processing units (CPUs) relative to the precision required by the DCT and IDCT calculations.

Method and apparatus for performing fast discrete cosine transforms and

An image processing system operates at reduced resolution to reduce computational complexity while remaining fully compatible with full resolution decoders. A video input signal is subsampled and encoded at the resulting lower resolution. The encoded signal is filled with zero terms to produce an encoded signal having the same number of terms as a full resolution encoded signal. In a motion-compensated hybrid coder, the decoder section also includes a subsampling system, so that the reconstructed video signal is produced at the same resulting lower resolution. The encoder section and the decoder section are each inverse functions of the other, eliminating a drift problem associated with prior systems.

Image signal coder operating at reduced spatial resolution

A method is provided for performing a fast 3-coefficient Discrete Cosine Transform (DCT) in a software implementation. The method provided exploits symmetries and statistical properties of the coefficients found in the DCT. As a result of the symmetries and statistical distribution of coefficients typically found in the DCT of typical images in image processing applications, the 3-coefficient DCT may be readily performed using as few as three input sample values from an input image block. The method selects the samples from locations in the image block where they are at peaks of the basis functions for the coefficients included, thus maximizing noise immunity. The method also provides for switching between performing the 3-coefficient DCT and a full (or other) DCT as required by image quality. Finally, the method may be generalized to perform a reduced coefficient DCT of any number of coefficients less than all coefficients in a complete output block.

Method and apparatus for performing fast reduced coefficient discrete

A system for, and method of, enhancing a digitized image signal according to a helper signal architecture are described. The architecture includes an analysis filter, responsive to a digitized image signal, for filtering the digitized image signal, corresponding to a first frequency band, to produce a first frequency band signal. The first frequency band signal is then applied to a point operator, which modifies the first frequency band signal in accordance with a non-linear characteristic. The non-linear characteristic includes a first region having a negative slope for low amplitude input signals. The non-linearity further includes a second region having a positive slope for informational components of an input signal so that informational components of the first frequency band signal cause the point operator to produce a modified signal having components that relate to the input signal according to the positive slope. The modified signal is then received by an synthesis filter, corresponding to the analysis filter, to produce a helper signal. The helper signal and the digitized image signal are then added to yield an enhanced digitized image signal.

Method and apparatus for enhancing images using helper signals

A digital watermarking method and apparatus allows for the watermarking of a digital video signal in a compressed form, thereby allowing watermarking of a pre-compressed video sequence without requiring the decoding and re-coding of the signal. The watermark signal is a sequence of information bits which has been modulated by a pseudo-random noise sequence to spread it in the frequency domain. The video signal is transform coded, preferably with a discrete cosine transform, and a watermark signal, which has been transform coded using the same type of transform, is added to the coded video signal. The system also includes bitstream control to prevent an increase in the bit rate of the video signal. This allows the system to be used with transmission channels having strict bit rate constraints. For each transform coefficient of the video signal, the number of bits necessary to encode the watermarked coefficient is compared to the number of bits necessary to encode the unwatermarked coefficient. If more bits are required to transmit a watermarked coefficient than to transmit the corresponding unwatermarked coefficient, the watermarked coefficient is not output, and the unwatermarked coefficient is output in its place. When watermarking interframe coded data, a drift compensation signal may be used to compensate for the accumulating variations in the decoded video signal stored at the receiver. The system may also include an encryption/decryption capability, with the watermarking apparatus located at either the transmitting or receiving end of the transmission channel.

Growing community of inventors

Spardorf, Germany

Bernd Girod