Telefonaktiebolaget Lm Ericsson (publ)

Ananya Muddukrishna

José Araújo

AmirHossein Taher Kouhestani

Diego Gonzalez Morin

Ioannis Karagiannis

Lars M Andersson

Lars Andersson

Simona Gugliermo

Paula Cubero

A device is disclosed that is configured to perform localization using one or both of a monocular camera and a depth sensor that are transportable with the device. The device includes at least one processor operationally connected to the monocular camera and the depth sensor. The device also includes at least one memory storing program code that is executed by the at least one processor to perform operations to receive image data from the monocular camera. The operations determine a benefit level of activating the depth sensor for localization, based on the image data, and activate the depth sensor for localization based on a determination that the benefit level of activating the depth sensor satisfies an activation rule. Related methods and computer program products are also disclosed.

Depth sensor activation for localization based on data from monocular camera

A method performed by a device for occlusion handling in augmented reality is provided. The device can generate at least one pixel classification image in a frame including an occluding object and having foreground, background, and unknown pixels. Generation of the at least one pixel classification image can include (1) calculating an initial foreground pixel probability image, and an initial background pixel probability image, and (2) calculating a normalized depth image based on depth information of the occluding object. The device can obtain an alpha mask to blend a virtual object and the foreground of the at least one pixel classification image based on determining a color of the unknown pixels. The device can render a final composition of an augmented reality image containing the virtual object occluded by the occluding object based on applying the alpha mask to pixels in the at least one pixel classification image.

Methods for handling occlusion in augmented reality applications using memory and device tracking and related apparatus

A device is disclosed that is configured for performing localization using one or both of a depth sensor and a monocular camera that are transportable with the device. The device is adapted to receive depth data from the depth sensor, determine a benefit level of activating the monocular camera for localization, based on the depth data, and activate the monocular camera for localization based on a determination that the benefit level of activating the monocular camera satisfies an activation rule. Related methods and computer program products are also disclosed.

Monocular camera activation for localization based on data from depth sensor

A method of controlling a portable device including a camera, the method including: performing localization of the portable device using a localization algorithm having as an input image data representing images captured by the camera; identifying a current focus area of the camera; determining a desired focus area for the camera; determining that a change of focus is required when the desired focus area is different to the current focus area; and generating a control signal configured to cause the focus of the camera to change in respect of a new focus area.

Method of controlling a camera

A method for determining a transformation between a first coordinate system of an ultrasonic haptic device and a second coordinate system of a visual sensor device. The method includes: triggering generation of an ultrasonic focal point; obtaining images depicting a body part of a user while the ultrasonic focal point is active; determining a position of the ultrasonic focal point in the second coordinate system when the body part of the user is in the ultrasonic focal point; repeating the triggering, obtaining and determining; and calculating a first transformation between the first coordinate system and the second coordinate system based on the positions of the ultrasonic focal points in the first coordinate system and the second coordinate system to thereby calibrate a relationship between the ultrasonic haptic device and the visual sensor device.

Determining a transformation between coordinate systems in an ultrasonic haptic device and a visual sensor device

A method () of controlling a portable device comprising a first camera and a second camera facing in the same direction. The method comprises: selecting () one of the first camera and the second camera as a visualization camera; initializing () a localization algorithm having as an input image data representing images captured by one of the first camera and the second camera; determining () a respective focus score for at least one of the first camera and the second camera, said focus score indicating a focus quality of features identified from images captured by one of the respective camera; selecting (,) one of the first camera and the second camera as an enabled camera based on the at least one focus score; and generating a control signal configured to cause the selected camera to be enabled such that the image data representing images captured by the enabled camera are provided as the input to the localization algorithm.

Growing community of inventors

Enskededalen, Sweden

Ananya Muddukrishna