Sony Corporation

Sony Mobile Communications Inc.

Sony Mobile Communications Ab

Sony Ericsson Mobile Communications Ab

Pär-Anders Aronsson

Ola Karl Thörn

Martin Ek

Håkan Jonsson

Andreas Kristensson

Magnus Landqvist

Henrik Bengtsson

Gunnar Klinghult

David De Léon

Magnus Jendbro

Linus Mårtensson

Hakan Jonsson

Pär Stenberg

Lars Nord

Anders Isberg

Peter Isberg

Olivier Moliner

Karl Ola Thörn

Erik Johan Vendel Backlund

Erik Backlund

Per Magnus Landqvist

Par Stenberg

Gert Magnus Jendbro

Ola Thörn

Linus MÅRTENSSON

A portable electronic equipment comprises a gaze tracking device configured to track an eye gaze direction of a user in a time interval. The portable electronic equipment comprises a processing device coupled to the gaze tracking device and configured to generate heat map data for the eye gaze direction, generate saliency map data for a field of view of the user, and identify at least one point of interest in the field of view based on both the heat map data and the saliency map data.

Portable electronic equipment and method of controlling a portable electronic equipment

The invention is directed to systems, methods and computer program products for gaze tracking. An exemplary method includes directing light into an eye using a projector; detecting, using an image-capturing module, a reflection from a surface associated with the eye; and determining a line of sight associated with the eye based on the detected reflection. In some embodiments, the light comprises infra-red light. In some embodiments, the projector comprises a laser. In some embodiments, the projector comprises a liquid crystal on silicon (LCoS) chip. In some embodiments, the surface associated with the reflection is at least one of the cornea, the iris, or the retina.

Gaze tracking with projector

The present invention relates to a method and system for providing access to a device for a user. The method comprises the steps of receiving an access attempt from the user to the device, identifying the user attempting to access the device, retrieving personal information from a database related to the user, the personal information comprising personal traits of the user, selecting a visual challenge configured based on the personal information, issuing the visual challenge to the user, receiving visual input corresponding to an eye-movement of the user relating to the visual challenge, determining whether the user passed the visual challenge based on the received visual input corresponding to an eye movement of the user, and allowing access to the device for the user if the user passes the visual challenge, or denying access to the device for the user if the user fails the visual challenge.

Method and system for providing access to a device for a user

An apparatus and method generate a three-dimensional image by presenting, using a stereoscopic display, a representation of a scene comprising one or more objects, tracking a gaze of the user to determine a direction of gaze within the scene, determining depths associated with one or more objects in the scene, and determining which of the objects in the scene are inside and which are outside a comfort zone based at least in part on the direction of gaze of the user and the depths associated with the one or more objects in the scene. In some embodiments, the method includes identifying one or more objects proximate the direction of gaze of the user, determining depths associated with the one or more identified objects, determining a range of depths based at least in part on the depths associated with the one or more identified objects, and establishing the comfort zone based at least in part on the range of depths. In some embodiments, the method includes modifying the presented representation of the scene based on which of the objects are outside the comfort zone. In some embodiments, the method includes focusing the stereoscopic display based at least in part on the determination of which objects are inside the comfort zone, tracking the gaze of the user to determine a second direction of gaze within the scene different from the direction of gaze within the scene, re-determining depths associated with one or more objects in the scene, re-determining which of the objects in the scene are inside and which are outside the comfort zone based at least in part on the second direction of gaze of the user and the re-determined depths associated with the one or more objects in the scene, and re-focusing the stereoscopic display based at least in part on the determination of which objects are inside the comfort zone.

Gaze controlled focusing of stereoscopic content

An electronic device comprises a display to output a video, a user interface for controlling a navigation in the video along a time axis, and a processing device. The processing device is configured, when operating in an operating mode in which an object shown in a plurality of frames of the video is selected by a user input, to determine a magnitude of a speed vector of the object, and to apply a time scaling factor which depends on the determined magnitude of the speed vector of the object to the navigation along the time axis.

Electronic device and method for controlling navigation in a video

The present invention relates to a method for generating trajectory data for video data. According to the method, an eye movement of an eye () of a viewer () viewing moving visual images is captured with a capturing device (). The trajectory data () is automatically determined based on the eye movement with a processing device () and the trajectory data () is automatically assigned to the video data comprising the moving visual images.

Generating trajectory data for video data

Operating a display of a user equipment. The present invention relates to a method for operating a display () of a user equipment (). The display () is configured to display an object (). A permission is assigned to the object (), which defines an allowance for a person (-) to view the object (). According to the method, a gaze position () of a person () looking at the display () is determined, which defines a position on the display () at which the person () is looking. A distance between the gaze position () and a position of the object () is determined and furthermore, it is determined, if the person () is allowed to view the object based on the permission assigned to the object (). If the person () is not allowed to view the object (), the object () is concealed depending on the determined distance between the gaze position () and the position of the object ().

Operating a display of a user equipment

A digital photograph is processed by receiving a communication related to the digital photograph from an application external to an image storage device that stores the digital photograph. Parameters related to the application are processed. The digital photograph is changed based on the parameters related to the application. Related methods, devices, and/or computer program products are described.

Processing digital photographs in response to external applications

One or more devices may receive, from a media presentation device worn by a user, sensory data comprising at least information describing orientation of the media presentation device. The one or more devices may also determine an approximate direction of a gaze of the user in a three dimensional audio space based on the information describing the orientation of the media presentation device, identify a sound source at which the user gazes based on the approximate direction of the gaze of the user in the three dimensional audio space, obtain audio data associated with the sound source based on an identity of the identified sound source, determine an action to perform on the audio data associated with the sound source, and perform the determined action.

Amplifying audio-visual data based on user's head orientation

A portable electronic equipment comprises a first sensor to record media and at least one second sensor to capture data representing a physical condition of a user of the portable electronic equipment, the at least one second sensor being configured to capture the data in response to the first sensor recording the media. A processing device is interfaced with the at least one second sensor. The processing device is configured to retrieve the data captured by the at least one second sensor, to generate metadata for the recorded media based on the data, the metadata being indicative of the physical condition, and to cause the metadata to be stored in association with the recorded media.

Portable electronic equipment and method of recording media using a portable electronic equipment

A system includes a processing logic and output logic. The processing logic is configured to receive information identifying points of interest, identify at least one of location or distance information from each of the points of interest to the system, and sort the points of interest based on the location or distance information. The output logic is configured to project information identifying the points of interest onto a surface, wherein the projected information is displayed in accordance with the sorting.

User interface with location mapping

An apparatus and method generate a three-dimensional image by determining, using a light-field camera, a depth map corresponding to an environment. The depth map represents how light falls in the environment. The method also includes determining a parallax occlusion map of the environment and creating, using the depth map and the parallax occlusion map, a three-dimensional image representing the environment. In some embodiments, the method includes taking a first picture of the environment with a first flash intensity and a second picture of the environment with a greater second flash, determining differences between the first picture of the environment and the second picture of the environment, determining one or more properties of the environment based at least in part on the determined differences and dynamically re-lighting the three-dimensional image using the depth map, the parallax occlusion map, and one or more of the determined properties of the environment.

Presenting three dimensional depth

This disclosure is directed to a sound recording arrangement comprising a sound recording arrangement and a method in the sound recording arrangement for amplifying sounds in a primary gaze direction of the user of the sound recording arrangement. The method comprises the actions of recording sounds arriving at a sound recording unit from objects in the field of view of the user, and recording a first set of images of the head and/or the eyes of the user, and determining a primary gaze direction of the user based on the first set of images, and amplifying sounds arriving in the primary gaze direction compared to sounds arriving from other directions.

Directional sound capturing

The invention is directed to systems, methods and computer program products for transferring content between electronic devices via skin input. An exemplary method includes detecting, by an interface device, an input received on a user's skin, wherein the interface device is in electronic communication with at least one of the first device or the second device; in response to detecting the input, determining the type of input; and at least one of: in response to determining the type of input is a first type of input, initiating transmission of content from the first device to the second device; or in response to determining the type of input is a second type of input, initiating reception of content at the second device.

Content transfer via skin input

The invention is directed to systems, methods and computer program products for providing focus control for an image-capturing device. An exemplary method includes capturing an image frame using an image-capturing device and recording video tracking data and gaze tracking data for one or more image frames following the captured image frame and/or for one or more images frames prior to the captured image frame. The exemplary method additionally includes calculating a focus distance and a depth of field based at least partially on the recorded video tracking data and recorded gaze tracking data. The exemplary method additionally includes displaying the captured image frame based on the calculated focus distance and the calculated depth of field.

Growing community of inventors

Malmö, Sweden

Pär-Anders Aronsson