National University of Singapore

Brian Youliang Lim

Chee Keong Tee

Wencan Zhang

Soon Hong Harold Soh

Weicong Sng

Tasbolat Taunyazov

Sheng Yuan Jethro Kuan

Hian Hian See

Abdul Fatir Ansari

A method and a system for training a neural network. The method includes receiving, by a processing device, a training image, a reference label and a reference class activation map, the reference label and the reference class activation map associated with a corresponding unbiased image of the training image and generating, using the processing device, a class label and a class activation map based on the training image using the neural network. The method also includes calculating, using the processing device, a classification loss value based on differences between the reference label and the class label, and a class activation map loss value based on differences between the reference class activation map and the class activation map and updating, using the processing device, the neural network to minimise the classification loss value and the class activation map loss value to improve accuracy of the neural network in generation of the class label and the class activation map.

Method and system for training a neural network

A classifying sensing system, a classifying method performed using a sensing system, a tactile sensor, and a method of fabricating a tactile sensor. The classifying sensing system comprises a first spiking neural network, SNN, encoder configured for encoding an event-based output of a vision sensor into individual vision modality spiking representations with a first output size; a second SNN encoder configured for encoding an event-based output of a tactile sensor into individual tactile modality spiking representations with a second output size; a combination layer configured for merging the vision modality spiking representations and the tactile modality spiking representations; and a task SNN configured to receive the merged vision modality spiking representations and tactile modality spiking representations and output vision-tactile modality spiking representations with a third output size for classification.

Event-driven visual-tactile sensing and learning for robots

Growing community of inventors

Singapore, Singapore

Brian Youliang Lim