Adobe, Inc.

Beijing Sensetime Technology Development Co., Ltd.

Lijun Wang

Zhe Lin

Jianming Zhang

Xiaohui Shen

Oliver Wang

Xiaogang Wang

Wanli Ouyang

Huchuan Lu

Disclosed are methods, apparatuses and systems for CNN network adaption and object online tracking. The CNN network adaption method comprises: transforming a first feature map into a plurality of sub-feature maps, wherein the first feature map is generated by the pre-trained CNN according to a frame of the target video; convolving each of the sub-feature maps with one of a plurality of adaptive convolution kernels, respectively, to output a plurality of second feature maps with improved adaptability; training, frame by frame, the adaptive convolution kernels.

Methods and systems for CNN network adaption and object online tracking

Joint training technique for depth map generation implemented by depth prediction system as part of a computing device is described. The depth prediction system is configured to generate a candidate feature map from features extracted from training digital images, generate a candidate segmentation map and a candidate depth map from the generated candidate feature map, and jointly train portions of the depth prediction system using a loss function. Consequently, depth prediction system is able to generate a depth map that identifies depths of objects using ordinal depth information and accurately delineates object boundaries within a single digital image.

Joint training technique for depth map generation

Techniques of generating depth-of-field blur effects on digital images by digital effect generation system of a computing device are described. The digital effect generation system is configured to generate depth-of-field blur effects on objects based on focal depth value that defines a depth plane in the digital image and a aperture value that defines an intensity of blur effect applied to the digital image. The digital effect generation system is also configured to improve the accuracy with which depth-of-field blur effects are generated by performing up-sampling operations and implementing a unique focal loss algorithm that minimizes the focal loss within digital images effectively.

Depth-of-field blur effects generating techniques

Disclosed are methods for object tracking. In an example, the method comprises: determining a region of interest (ROI) in a first frame of a video sequences; feeding the determined ROI forward through a first CNN (convolutional network) to obtain a plurality of first feature maps in a higher layer of the CNN and a plurality of second feature maps in a lower layer of the first CNN; selecting a plurality of feature maps from the first and second feature maps, respectively; predicting, based on the selected first and second feature maps, two target heat maps indicating a target location for said objects in the current frame, respectively; and estimating, based on the two predicated target heat maps, a final target location for the object in the current frame.

Growing community of inventors

Dalian, China

Lijun Wang