Zhejiang University

Zhejiang Lab

Mengwen Yuan

Gang Pan

Huajin Tang

Xiao Wang

Mengxiao Zhang

Yujing Lu

Wenyi Zhao

Chaofei Hong

A target tracking method and a target tracking system of a spiking neural network based on an event camera are provided. The method includes: acquiring a data stream of asynchronous events in a high dynamic scene of a target by an event camera as input data; dividing the data stream of the asynchronous events into synchronous event frames with millisecond time resolution; training a twin network based on a spiking neural network by a gradient substitution algorithm with a target image as a template image and a complete image as a searched image; and tracking the target by a trained twin network with interpolating a result of feature mapping to up-sample and obtaining the position of the target in an original image. The twin network includes a feature extractor and a cross-correlation calculator.

Target tracking method and system of spiking neural network based on event camera

Growing community of inventors

Hangzhou, China

Mengwen Yuan