Samsung Electronics Co., Ltd.

Korea Advanced Institute of Science and Technology

Postech Research and Business Development Foundation

Changbeom Park

Byung In Yoo

HyunJeong Lee

Dongwook Lee

Hyunjeong Lee

Seohyung Lee

Qiang Wang

Jiaqian Yu

Yiwei Chen

Jaejoon Han

Sung Kwang Cho

Ju Hwan Song

Changyong Son

Jingtao Xu

Hana Lee

Seungwook Kim

Siyang Pan

Seungju Han

Seung Wook Kim

Jongmin Lee

Youngjun Kwak

Seungin Park

Taekyung Kim

Solae Lee

Feng Qiu

Changick Kim

Minsu Cho

Byeongjun Park

Juhong Min

Sungyoul Park

Hyeongseok Son

A method with image correspondence includes: acquiring a plurality of feature map pairs corresponding to outputs of a plurality of layers of a convolutional neural network (CNN) in response to an input of an input image pair; selecting a portion of feature map pairs from among the plurality of feature map pairs based on a feature of each of the plurality of feature map pairs; generating a hyper feature map pair based on the selected portion of feature map pairs; and generating a correspondence result of the input image pair based on a correlation of the hyper feature map pair.

Method and apparatus with image correspondence

A method with object tracking includes: determining a first target tracking state by tracking a target from a first image frame with a first field of view (FoV); determining a second FoV based on the first FoV and the first target tracking state; and generating a second target tracking result by tracking a target from a second image frame with the second FoV.

Method and apparatus with object tracking using dynamic field of view

A method of generating a hyperlapse video includes: comparing a first reference point of a first image and a corresponding second reference point of a second image; based on the comparing, displaying a first user interface for matching the first reference point and second reference point; and determining whether to perform automatic shooting for the hyperlapse video based on whether the first reference point and the second reference point match.

Method and apparatus with hyperlapse video generation

A method with self-attention includes: obtaining a three-dimensional (3D) feature map; generating 3D query data and 3D key data by performing a convolution operation based on the 3D feature map; generating two-dimensional (2D) vertical data based on a vertical projection of the 3D query data and the 3D key data; generating 2D horizontal data based on a horizontal projection of the 3D query data and the 3D key data; determining an intermediate attention result through a multiplication based on the 2D vertical data and the 2D horizontal data; and determining a final attention result through a multiplication based on the intermediate attention result and the 3D feature map.

Method and apparatus with self-attention-based image recognition

A processor-implemented method with target object tracking includes: setting a search area for a target object included in an input image based on a position of a first target box in a template image; selecting a network path from a plurality of network paths of a neural network model according to a resizing ratio of a size of another image that is input to the neural network model to a size of the search area; and tracking the target object by estimating a position of a second target box corresponding to the target object in the input image according to the selected network path.

Method and apparatus with target object tracking

A method and apparatus with object tracking is provided. The method includes generating a mixed filter by fusing a short-term filter with a long-term filter; and performing object tracking on a current frame image based on the mixed filter. The short-term filter is dependent on a prediction of the current frame image in a video sequence, and the long-term filter is a previously generated long-term filter or is generated by optimizing the previously generated long-term filter based on an object template feature pool.

Method and apparatus with object tracking

An apparatus and a method of controlling a camera is provided. The apparatus includes a receiver configured to receive an image from an image sensor and a processor configured to detect a target object from the image, perform a first zoom adjustment operation of the camera including the image sensor based on whether the target object is changed and perform a second zoom adjustment of the camera based on a center point of the target object and a center point of the camera.

Apparatus and method of controlling camera with auto-zooming

A processor-implemented method with object tracking includes: performing, using a first template, forward object tracking on first image frames in a first sequence group; determining a template candidate of a second template for second image frames in a second sequence group; performing backward object tracking on the first image frames using the template candidate; determining a confidence of the template candidate using a result of comparing a first tracking result determined by the forward object tracking performed on the first image frames and a second tracking result determined by the backward object tracking performed on the first image frames; determining the second template based on the confidence of the template candidate; and performing forward object tracking on the second image frames using the second template.

A processor-implemented method with target tracking includes: generating a first target tracking result based on a search region of a current frame image; determining a scale feature of the first target tracking result; predicting a scale of a target in the search region based on the scale feature of the first target tracking result; and generating a second target tracking result by adjusting the first target tracking result based on a scale predicting result.

Method and apparatus with target tracking

A method and apparatus for object tracking are provided, where the object tracking method includes determining box information of candidate boxes in a current image frame and similarity scores of the candidate boxes based on including a search region of the current image frame with a template image corresponding to a target object, adjusting the similarity scores of the candidate boxes using a distractor map including distractor information of a previous image frame, determining a target box corresponding to the target object and a distractor box corresponding to a distractor of the target object from the candidate boxes based on the adjusted similarity scores, and updating the distractor map based on distractor information of the current image frame according to the distractor box.

A target object detection method and apparatus are provided. The target object detection method and apparatus are applicable to fields such as artificial intelligence, object tracking, object detection, and image processing. An object is detected from a frame image of a video including a plurality of frame images based on a target template set including one or more target templates.

Video object detection and tracking method and apparatus

A scene flow estimation method and apparatus are provided. The scene flow estimation method includes receiving a first feature pyramid and a second feature pyramid by encoding a first frame and a second frame of an input image through the same encoder, extracting a depth feature based on the first feature pyramid, extracting a motion feature based on the first feature pyramid and the second feature pyramid, generating an overall feature based on the depth feature and the motion feature, and estimating a scene flow based on the overall feature.

Method and apparatus with scene flow estimation

A method, apparatus, and system with tracking are disclosed. The apparatus is configured to acquire a feature map of a template image, a color histogram of a foreground of the template image that has an object, and a color histogram of a background of the template image other than the foreground, acquire a feature score map, and a bounding box map corresponding to the feature score map, based on the feature map of the template image and a feature map of a search image, acquire a color score map based on the color histogram of the foreground, the color histogram of the background, and a color value of the search image, acquire a final score map, and a bounding box map corresponding to the final score map, based on the feature score map, the color score map, and the bounding box map, and output the corresponding bounding box.

A target tracking method and apparatus is provided. The target tracking apparatus includes a memory configured to store a neural network, and a processor configured to extract feature information of each of a target included in a target region in a first input image, a background included in the target region, and a searching region in a second input image, using the neural network, obtain similarity information of the target and the searching region and similarity information of the background and the searching region based on the extracted feature information, obtain a score matrix including activated feature values based on the obtained similarity information, and estimate a position of the target in the searching region from the score matrix.

Method and apparatus for tracking target

A processor-implemented method with object tracking includes: determining an initial template image based on an input bounding box and an input image; generating an initial feature map by extracting features from the initial template image; generating a transformed feature map by performing feature transformation adapted to objectness on the initial feature map; generating an objectness probability map and a bounding box map indicating bounding box information corresponding to each coordinate of the objectness probability map by performing objectness-based bounding box regression analysis on the transformed feature map; and determining a refined bounding box based on the objectness probability map and the bounding box map.

Growing community of inventors

Seoul, South Korea

Changbeom Park