Nokia Technologies Oy

Lightmetrics Technologies Pvt. Ltd.

Nokia Corporation

Lighmetrics Technologies Pvt. Ltd.

Soumik Ukil

Krishna Govindarao

Gururaj Putraya

Ravi Shenoy

Mithun Uliyar

Veldandi Muninder

Pushkar Patwardhan

Krishna A G

Pranav Mishra

Basavaraja S V

Basavaraj Sv

Krishna Annasagar Govindarao

Gururaj Gopal Putraya

The invention provides a system and method of monitoring a vehicle during commute. The system comprising of one or more camera modules in communication with one or more computation device. A camera module is configured to collect multiple data during the commute including video frames of one or more views, and location, position, direction, orientation, velocity and the combination thereof of the vehicle. The collected data is sent to a computation device where the data is analyzed to identify events and the same will be notified to one or more user device(s). In one embodiment, the communication between the computation device and the camera module may be carried out wirelessly via Wi-Fi where the camera module is configured to act in one or more modes of communication such as an access point (AP) mode or a station (STA) mode or Wi-Fi direct or the combination thereof.

Vehicle monitoring system and method using a connected camera architecture

Methods and systems for facilitating driver behavior monitoring and evaluation of driver performance during a trip are provided. The method includes facilitating, by a processing system of an on-board detection device positioned in a vehicle, recording of media data using cameras mounted on the vehicle and multisensory data using sensors positioned in the vehicle. The media data includes a plurality of image frames. The method includes generating metadata based on at least one image frame of the plurality of image frames and the multisensory data, detecting an occurrence of an event based at least on the metadata and a set of configuration parameters, uploading the metadata and the media data of the event to a cloud server based on event upload rules, and facilitating a media status update flag corresponding to the event, the media status update flag representing a completion of uploading of the media data of the event.

Methods and systems for facilitating drive related data for driver monitoring

A method for estimating distance of an object from a moving vehicle is provided. The method includes detecting, by a camera module in one or more image frames, an object on a road on which the vehicle is moving. The method includes electronically determining a pair of lane markings associated with the road. The method further includes electronically determining a lane width between the pair of the lane markings in an image coordinate of the one or more image frames. The lane width is determined at a location of the object on the road. The method includes electronically determininga real world distance of the object from the vehicle based at least on number of pixels corresponding to the lane width in the image coordinate, a pre-defined lane width associated with the road and at least one camera parameter of the camera module.

Methods and systems for estimating distance of an object from a moving vehicle

A technique for digital stereo imaging is provided. According to an example embodiment, the technique comprises facilitating stereo image capturing means for capturing image data, said stereo image capturing means comprising a first imaging subsystem that comprises a first image sensor arranged to receive light via a first lens and a second imaging subsystem that comprises a second image sensor arranged to receive light via a second lens, wherein said first and second imaging subsystems are arranged such that the optical axes of said first and second lenses are in parallel to each other; reading pixel values from respective light-sensitive areas of said first and second image sensors, comprising reading pixel values for a first image from a first readout area on the first image sensor, reading pixel values for a second image from a second readout area on the second image sensor, and reading pixel values for support data from at least one portion of the light-sensitive area adjacent to the respective readout area on at least one of the first and second image sensors; and deriving disparity information pertaining to said first and second images on basis of said pixel values read for the first image, for the second image and for said support data.

Stereo imaging

Advanced driver assistance systems (ADAS) and methods for object detection such as traffic lights, speed signs, in an automotive environment, are disclosed. In an embodiment, ADAS includes camera system for capturing image frames of at least a part of surroundings of vehicle, memory comprising image processing instructions and processing system for detecting one or more objects in a coarse detection followed by a fine detection. Coarse detection includes detecting presence of the one or more objects in non-consecutive image frames of the image frames, where non-consecutive image frames are determined by skipping one or more frames of the image frames. Upon detection of presence of the one or more objects in coarse detection, fine detection of the one or more objects is performed in a predetermined number of neighboring image frames of a frame in which the presence of the objects is detected in coarse detection.

System and method for detecting objects in an automotive environment

In an example embodiment, method, apparatus and computer program product are provided. The method includes facilitating receipt of a plurality of VR contents and a plurality of video contents associated with an event captured by a plurality of VR cameras and a plurality of user camera devices, respectively. Each of the plurality of VR cameras comprises a plurality of camera modules with respective field of views (FOVs) associated with the event. The FOVs of the plurality of user camera devices are linked with respective FOVs of camera modules of the plurality of VR cameras based on at least a threshold degree of similarity between the FOV of the user camera device and the FOV of the camera module. The processor creates an event VR content by combining the plurality of VR contents and the plurality of video contents based on the linking of the FOVs.

Method, apparatus and computer program product for creating virtual reality content of an event

In an example embodiment, method, apparatus and computer program product for improving image and video captures using depth maps of viewfinder depth map, are provided. The method includes facilitating receipt of a viewfinder depth map of a scene, the viewfinder depth map comprising depth information of a plurality of objects in the scene. One or more objects are selected from the plurality of objects based on depth information of the one or more objects in the viewfinder depth map. Two or more images of the scene are facilitated to be captured by at least adjusting focus of a camera corresponding to the depth information of the one or more objects that are selected. In an example, a method also includes facilitating capture of an image of the scene by at least adjusting focus of a camera corresponding to the depth information of the two or more objects that are selected.

Improving focus in image and video capture using depth maps

A method and system for driver monitoring by fusing contextual data with event data to determine context as cause of event is provided. The method includes detecting an event from event data received from one or more inertial sensors associated with a vehicle of a driver or with the driver. The method also includes determining a context from an audio or video feed received from one or more devices associated with the vehicle or the driver. Further, the method includes fusing the event with the context to determine the context as a cause of the event. In addition, the method includes assigning a score to a driver performance metric based at least on the context and the event.

Method and system for driver monitoring by fusing contextual data with event data to determine context as cause of event

A method and apparatus for localizing a smartphone is disclosed. A plurality of lateral position samples of the smartphone based at least in part on a plurality of location coordinates, lane marking information and accuracy factors of the plurality of location coordinates are collected at a plurality of time instances. Lateral position of the smartphone in the moving vehicle based at least on the plurality of lateral position samples collected at the plurality of time instances is determined. One or more correlations between a vertical acceleration pattern associated with at least one front wheel and a vertical acceleration pattern associated with at least one rear wheel of the moving vehicle passing over one or more road discontinuities as computed from an accelerometer sensor present in the smartphone are determined. Longitudinal position of the smartphone in the moving vehicle based at least on the one or more correlations is determined.

Localizing a smartphone in a moving vehicle

In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of an image of a scene and determining a graph based on connecting nodes of the image. The nodes are either pixels or superpixels of the image. The graph is determined by determining one or more connections of a node to one or more nodes belonging to a pre-defined image region around the node in the image. The connections are associated with edge weights that are determined based on at least one of similarity parameters and spatial distances between the node and the one or more nodes. The method includes determining disparity values at the nodes of the image based at least on performing tree based aggregation of a cost volume on the graph, where the cost volume is associated with the image and at least one view image of the scene.

Method, apparatus and computer program product for disparity estimation in images

A method, apparatus and computer program for: receiving a spatial audio input; determining a direction of interest from the spatial audio input; and generating a spatial audio output dependent on the spatial audio input and the direction of interest.

Method, apparatus and computer program for generating an spatial audio output based on an spatial audio input

In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of primary depth map and plurality of color segments, the primary depth map associated with a first image and a second image that are stereoscopic pair of images of a scene, and the color segments associated with the first image. The method includes generating plurality of disparity planes based on the color segments and the primary depth map. The method includes determining aggregated cost volume between pixels of the first and second images for the disparity planes. The method includes assigning plane labels corresponding to the disparity planes to pixels of the first and second images based on the aggregated cost volume, an individual pixel being assigned a plane label. The method includes generating secondary depth map based on the plane labels assigned to the pixels of the first and second images.

Method, apparatus and computer program product for depth estimation of stereo images

In an example embodiment, a method, apparatus and computer program product are provided. The method includes computing a first cost volume for a light-field image. A first depth map comprising depth information of the plurality of sub-images of the light-field image is computed based on the first cost volume. A first view image comprising reconstruction information is reconstructed based on the depth information of the plurality of sub-images. A second cost volume corresponding to the first cost volume is computed based on the reconstruction information. The second cost volume is filtered based on the first view image to generate an aggregated cost volume. A second depth map is generated based on the aggregated cost volume. The second depth map facilitates generation of a second view image that is associated with a resolution higher than a resolution of the first view image.

Method, apparatus and computer program product for depth estimation

In an example embodiment, method, apparatus and computer program product are provided. The method includes facilitating receipt of first image (I) and second image (I) of a scene. Cost volume between images Iand Ifor set of foreground labels (FL) and set of background labels (BL) is determined that includes matching costs of pixels in Iand corresponding pixels in Ifor FL and BL. Reduced cost volume is determined from the cost volume, including matching costs of pixels in Iand corresponding pixels in Ifor FL and a background label (L) of BL, where matching cost of an individual pixel in Iand corresponding pixel of the individual pixel in Ifor Lincludes minimum matching cost from a set of matching costs of the individual pixel for BL. A disparity map is generated by performing cost aggregation of the reduced cost volume in Iand I

Method, apparatus and computer program product for disparity estimation of foreground objects in images

In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of a first image and a second image of a scene comprising one or more objects. The method includes detecting the objects in the first image by detecting object point of the objects in the first image. The method includes detecting the object points of the objects in the second image based on detection of the object points of the objects in the first image. Detection of an object point in the second image that corresponds to an object point of the first image comprises searching for the object point on an epipolar line in the second image corresponding to the object point of the first image. The method includes determining disparity values between the objects points in the first image and the object points in the second image.

Growing community of inventors

Bengaluru, India

Soumik Ukil