Sony Group Corporation

Sony Corporation

Abhishake Jha

Shehnaz Mohamed

An electronic apparatus and method for visualization of AI-generated predictions from 3D data is provided. The electronic apparatus acquires 3D data associated with a 3D environment that includes a 3D object and partitions the 3D data into data blocks. The electronic apparatus generates variations of the 3D data based on a modification of the data blocks and further generates 3D object detection results corresponding to the variations based on an application of a 3D object detection model on the variations. The electronic apparatus trains a regression model based on the 3D object detection results and determines a weight value, based on the trained regression model, that indicates a likelihood that a data block of the data blocks belongs to the 3D object. The electronic apparatus generates a first 3D heatmap visualization of the 3D object based on the weight value for each data block of the data blocks.

Visualization of AI-generated predictions from 3D data

An electronic device includes a memory to store neural network model trained for classification tasks of real-time applications. The neural network model is trained with plurality of training data points. The electronic device includes circuitry to retrieve a plurality of external data points. The electronic device applies the neural network model on the plurality of external data points to determine a plurality of impact scores for each external data point. The plurality of impact scores indicates amount of contribution of each training data point towards a prediction of each external data point. The electronic device selects a set of external data points based on the plurality of impact scores. The electronic device updates the plurality of training data points with the set of external data points to generate a second plurality of training data points and re-trains the neural network model based on the second plurality of training data points.

Training neural network model based on data point selection

An electronic apparatus and method for heatmap visualization of object detections is provided. The electronic apparatus inputs an image frame including an object of interest to Deep Neural Network (DNN) model and extracts an object detection result associated with the object of interest as output of the DNN model for the input image frame. The object detection result includes bounding box coordinates for the object of interest. The electronic apparatus segments the input image frame into a plurality of image portions based on the bounding box coordinates and determines, for each of the plurality of image portions, a weight value indicative of a likelihood that a corresponding image portion belongs to the object of interest. The electronic apparatus generates, based on the determined weight value, a visualization frame which includes heatmap visualization of a region that is included in the image frame and is bounded by the bounding box coordinates.

Growing community of inventors

Bengaluru, India

Abhishake Jha