Shanghai Jiao Tong University

Other

Hongkai Xiong

Chenglin Li

Wenrui Dai

Junni Zou

Yangmei Shen

Shaohui Li

Fei Li

Qin Yang

Yuchen Liu

Yaoming Wang

Haoran Lv

Ziyang Zheng

The present disclosure provides a variable-bit-rate image compression method and system, an apparatus, a terminal, and a storage medium. The variable-bit-rate image compression method includes: obtaining an initial feature map from a to-be-encoded image; quantizing the initial feature map by a dead-zone quantizer; performing entropy encoding on the quantized feature map and hyper-prior information to obtain a compressed bit-stream; performing entropy decoding on the compressed bit-stream, and recovering quantized hyper-prior information and the quantized feature map; performing inverse quantization on the quantized feature map to obtain a reconstructed feature map; obtaining a reconstructed image from the reconstructed feature map; and adjusting quantization and inverse quantization parameters according to a target bit-rate or target distortion. The present disclosure provides a precise bit-rate control solution, makes the bit-rate of the compressed bit-stream better adapt to the dynamic change of a network bandwidth, and has an extremely high actual application value.

Variable-bit-rate image compression method and system, apparatus, terminal, and storage medium

A three-dimensional point cloud upsampling method includes: dividing a three-dimensional point cloud into overlappable point cloud blocks which have a fixed number of points and are capable of covering all the points; extracting hierarchical features according to point coordinates in the point cloud blocks; achieving point set feature expansion of the extracted hierarchical features by using multi-scale heat kernel graph convolution; and reconstructing point coordinates in an upsampled three-dimensional point cloud from the expanded features. According to the present disclosure, detail information enhancement with different fine granularities can be performed on the three-dimensional point cloud which is sparse and nonuniformly distributed in the space, and at the same time, good stability is provided for overcoming potential noise disturbance and local deformation. The method can promote the uniformity of spatial distribution of the upsampled dense point cloud, and ensure the accurate representation for a geometric structure of a target object.

Three-dimensional point cloud upsampling method, system and device, and medium

The present disclosure provides an image classification method for maximizing mutual information, device, medium and system, the method including: acquiring a training image; maximizing the mutual information between the training image and a neural network architecture, and automatically determining the network architecture and parameter of the neural network; and processing image data to be classified using the obtained neural network to obtain an image classification result. According to the present disclosure, the network architecture and parameter of the neutral network are automatically designed and determined by maximizing the mutual information based on given image data without burdensome manual design and saving human and computational resource consumption. The present disclosure can automatically design and obtain a neural network-based image classification method in a very short time, and at the same time can achieve higher image classification accuracy.

Image classification method for maximizing mutual information, device, medium and system

A graph dictionary learning method for a 3D point cloud comprises: obtaining N point clouds to form training dataset; performing voxelization process on the point cloud data to obtain voxelized point cloud data of the training dataset; performing voxel block division on the point cloud data of the training dataset, selecting a plurality of voxel blocks as the training dataset, and constructing a graph dictionary learning model according to the training dataset; and performing iterative optimization on the graph dictionary learning objective function to obtain a graph dictionary for encoding and decoding a 3D point cloud signal. The present disclosure effectively uses the spatial correlation between point cloud signals to near-optimally remove the redundancy among point cloud signals.

3D point cloud encoding and decoding method, compression method and device based on graph dictionary learning

An image processing method for sparse image reconstruction, image denoising, compressed sensing image reconstruction or image restoration, comprising: establishing a general linear optimization inverse problem under the 1-norm constraint of a sparse signal; establishing a differentiable deep network model based on convex combination to solve the problem on the basis of standard or learned iterative soft shrinkage thresholding algorithm; and introducing a deep neural network of arbitrary structure into the solving step to accelerate the solving step and reducing a number of iterations needed to reach a convergence. The present disclosure combines the traditional iterative optimization algorithm with the deep neural network of arbitrary structure to improve the image reconstruction performance and ensure fast convergence to meet the current needs of sparse image reconstruction.

Image processing method, system, device and storage medium

In a 3D point cloud compression system based on multi-scale structured dictionary learning, a point cloud data partition module outputs a voxel set and a set of blocks of voxels of different scales. A geometric information encoding module outputs an encoded geometric information bit stream. A geometric information decoding module outputs decoded geometric information. An attribute signal encoding module outputs a sparse coding coefficient matrix and a learned multi-scale structured dictionary. An attribute signal compression module outputs a compressed attribute signal bit stream. An attribute signal decoding module outputs decoded attribute signals. A 3D point cloud reconstruction module completes reconstruction. The system is applicable to lossless geometric and lossy attribute compression of point cloud signals. Based on the natural hierarchical partitioning structure of point cloud signals, the system gradually improves the reconstruction quality of high-frequency details in the signals from coarse scale to fine scale, and achieves significant gains.

3D point cloud compression system based on multi-scale structured dictionary learning

The present disclosure provides a saliency prediction method and system for a 360-degree image based on a graph convolutional neural network. The method includes: firstly, constructing a spherical graph signal of an image of an equidistant rectangular projection format by using a geodesic icosahedron composition method; then inputting the spherical graph signal into the proposed graph convolutional neural network for feature extraction and generation of a spherical saliency graph signal; and then reconstructing the spherical saliency graph signal into a saliency map of an equidistant rectangular projection format by using a proposed spherical crown based interpolation algorithm. The present disclosure further proposes a KL divergence loss function with sparse consistency. The method can achieve excellent saliency prediction performance subjectively and objectively, and is superior to an existing method in computational complexity.

Saliency prediction method and system for 360-degree image

The disclosure provides a method and system for encoding bit rate control and version selection for a dynamic adaptive video streaming media. The method adopts a dynamic adaptive streaming media encoding technology to encode each original video into a plurality of versions with different bit rates at a server and determines video version subsets to be encoded by the original videos and specific encoding parameters of each video version by taking an encoding complexity-bit rate-distortion model for different original video contents, constraints on an encoding bit rate and a computing resource of the video server, network connection conditions of different users and a video-on-demand probability distribution into consideration, and finally, the video server outputs an optimal video version set through encoding, so as to maximize the overall quality of videos watched by users.

Growing community of inventors

Shanghai, China

Hongkai Xiong