Agency for Science, Technology and Research

Nanyang Technological University

Susanto Rahardja

Xiao Lin

Zhengguo Li

Rongshan Yu

Shiqian Wu

Jinghong Zheng

Keng Pang Lim

Zijian Orson Zhu

Haibin Huang

Feng Pan

Weisi Lin

Hui Lan

Ming Zhang

Zhuliang Yu

Zhongkang Lu

Ee Ping Ong

Susu Yao

Dajun Wu

Xiaokang Yang

Si Wu

Te Li

Wei Yao

Wee Boon Choo

Shoulie Xie

Dong-Yan Huang

In various embodiments of the present disclosure, there is provided a method for processing an input image. The method includes generating a base layer portion and a detail layer portion from the input image by carrying out a linear transformation of pixels of a guidance image, and determining, for each of the pixels of the guidance image, a variance of the pixels in a surrounding window of pixels. Further, the method includes determining, for each of the pixels of the guidance image, a weight value of the pixels based on the determined variance, wherein the pixels are weighted in the linear transformation according to the determined weight value. Accordingly, a system for processing an input image is also provided.

Method and system for processing an input image based on a guidance image and weights determined thereform

Embodiments provide a method for processing an input image having a plurality of pixels, wherein each pixel has a pixel position. The method may include determining, for each pixel position, a vector based on the input image; and determining, for each pixel position, a detail value for the pixel position based on the determined vectors at a plurality of neighboring pixel positions within a predetermined neighboring block of the pixel position.

Method and device for image processing

Embodiments provide a method for processing a first image based on a second image, wherein each pixel in the first image has a plurality of color components and has a corresponding pixel in the second image, and wherein each value of a color component in the first image corresponds to a value of a color component in the second image. The method may include deciding, for each color component of a pixel in the first image, whether to modify the value of the color component dependent on a predetermined criterion. The method may further include determining a similarity index between the pixel in the first image and the corresponding pixel in the second image based on, for each color component of the pixel, the value of the color component of the pixel, or if it is decided that the value of the color component of the pixel is to be modified, the corresponding value of the color component in the second image.

A method for aligning a plurality of first digital pictures. Each first digital picture includes a plurality of pixels wherein each pixel is associated with a pixel value. The method includes generating a second digital picture for each first digital picture. Generating the second digital picture for the first digital picture includes determining, for each of a plurality of pixels of the first digital picture, a number representing the pixel values of a plurality of pixels in a neighborhood of the pixel relatively to the pixel value of the pixel. The method further includes assigning the number as a pixel value to a pixel of the second digital image corresponding to the pixel of the first digital image. The method further includes generating aligning parameters based on the plurality of second digital pictures. The method further includes aligning the plurality of first digital pictures based on the aligning parameters.

Method and device for aligning a plurality of digital pictures

Embodiments provide a method for merging a plurality of first digital pictures, wherein each first digital picture includes a plurality of pixel values. The method includes extracting details from the plurality of first digital pictures. The method further includes combining the pixel values of the plurality of first digital pictures to generate a combined digital picture. The method further includes modifying the combined digital picture with the extracted details to generate a merged digital picture.

Method and a device for merging a plurality of digital pictures

A method for encoding a digital signal into a scalable bitstream comprising quantizing the digital signal, and encoding the quantized signal to form a core-layer bitstream, performing an error mapping based on the digital signal and the core-layer bitstream to remove information that has been encoded into the core-layer bitstream, resulting in an error signal, bit-plane coding the error signal based on perceptual information of the digital signal, resulting in an enhancement-layer bitstream, wherein the perceptual information of the digital signal is determined using a perceptual model, and multiplexing the core-layer bitstream and the enhancement-layer bitstream, thereby generating the scalable bitstream. A method for decoding a scalable bitstream into a digital signal comprising de-multiplexing the scalable bitstream into a core-layer bitstream and an enhancement-layer bitstream, decoding and de-quantizing the core-layer bitstream to generate a core-layer signal, bit-plane decoding the enhancement-layer bitstream based on perceptual information of the digital signal, and performing an error mapping based on the bit-plane decoded enhancement-layer bitstream and the de-quantized core-layer signal, resulting in an reconstructed transformed signal, wherein the reconstructed transformed signal is the digital signal.

Method for encoding a digital signal into a scalable bitstream; method for decoding a scalable bitstream

Embodiments of the invention provides a method and device for assigning bitrates to a plurality of channels in a scalable audio encoding/truncation process. Different bitrates are assigned to different channels in the scalable audio encoding/truncation process.

Method and device of bitrate distribution/truncation for scalable audio coding

A scalable coder having a grid motion estimation and compensation module (), a motion compensation temporal filtering module (), a scalable coding module (), a discrete transformation module (), and a packetization module (). The grid-motion estimation and compensation module () outputs a scalable motion vector from the source video data, supplied resolution and bit rate parameters. The motion compensation temporal filtering module () generates, from the source video data and the scalable motion vector, a residual image corresponding to the difference between the present and previous image frames. The scalable coding module () is coupled to receive and encode the scalable motion vector. The discrete transformation module () is configured to receive and domain transform the supplied video to a sequence of coefficients. The packetization module is coupled to the scalable coding module () and the discrete transformation module (), and is operable to combine the encoded scalable motion vector and the sequence of coefficients into a packet.

Scalable video coding with grid motion estimation and compensation

A Method for encoding a picture with a first region and a second region is described wherein the first region is encoded according to a first encoding scheme, the second region is encoded according to a second encoding scheme and the second encoding scheme is carried out taking a parameter representing the visual perception of the second region into account.

Method for encoding a picture, computer program product and encoder

A method for performing a domain transformation of a digital signal from the time domain into the frequency domain and vice versa, the method including performing the transformation by a transforming element, the transformation element comprising a plurality of lifting stages, wherein the transformation corresponds to a transformation matrix and wherein at least one lifting stage of the plurality of lifting stages comprises at least one auxiliary transformation matrix and a rounding unit, the auxiliary transformation matrix comprising the transformation matrix itself or the corresponding transformation matrix of lower dimension. The method further comprising performing a rounding operation of the signal by the rounding unit after the transformation by the auxiliary transformation matrix.

Method for performing a domain transformation of a digital signal from the time domain into the frequency domain and vice versa

A method for transforming a digital signal from the time domain into the frequency domain and vice versa using a transformation function comprising a transformation matrix, the digital signal comprising data symbols which are grouped into a plurality of blocks, each block comprising a predefined number of the data symbols. The method includes the process of transforming two blocks of the digital signal by one transforming element, wherein the transforming element corresponds to a block-diagonal matrix comprising two sub matrices, wherein each sub-matrix comprises the transformation matrix and the transforming element comprises a plurality of lifting stages and wherein each lifting stage comprises the processing of blocks of the digital signal by an auxiliary transformation and by a rounding unit.

Method for transforming a digital signal from the time domain into the frequency domain and vice versa

A method for inter-mode prediction in video coding, the method comprising checking a data block of an image for zero motion; computing frame difference of the data block based on the checking for zero motion; and making an inter-mode prediction selection based on the computed frame difference.

Mode decision for inter prediction in video coding

Systems and methods for scalably encoding and decoding coded data are presented. One exemplary method for scalably coding data includes classifying, based upon at least one predetermined criteria, each of the plurality of data received as either (i) perceptually relevant data or (ii) perceptually irrelevant data. The perceptually relevant data is scalably coded, and the perceptually irrelevant data is non-scalably coded. Subsequently, the scalably coded perceptually relevant data and the non-scalably coded perceptually irrelevant are combined into a coded data stream for transmission.

Systems and methods for scalably encoding and decoding data

A system for the context-based for the context-based encoding of an input signal includes a domain transform module and a context-based coding module. The domain transform module is operable to convert the input signal into a sequence of transform coefficients c[i]. The context-based coding module includes a bit-plane scanning module, and context modeling module, and a statistical encoding module. The bit-plane scanning module is operable to produce a bit-plane symbol bps [i,bp] for each transform coefficient c[i] and each bit-plane [bp]. The context modeling module is operable to assign one or more context values to each of the received bit plane symbols bps [i,bp]. The statistical coding module is operable to code each of the bit plane symbols bps [i,bp] as a function of one or more of the corresponding context values to produce a context-based encoded symbol stream.

Context-based encoding and decoding of signals

A method for processing bit symbols generated by a data source, in particular a video, still image or audio source, comprising the following steps of constructing a plurality of bit-planes from the data source, each bit-plane comprising a plurality of bit-plane symbols; scanning the bit-plane symbols of each bit-plane to generate a binary string of bit-plane symbols; and encoding the binary string of the bit-plane symbols using a statistical model, wherein the statistical model is based on statistical properties of a Laplacian probability distribution function which characterizes the data source.

Growing community of inventors

Singapore, Singapore

Susanto Rahardja