Microsoft Technology Licensing, LLC

Morgan Kolya Venable

Bernard Kerr

David Nister

Vaibhav Thukral

Weerapan Wilairat

Chris Aholt

Bernard James Kerr

Anton Oguzhan Alford Andrews

Craig Lichtenstein

Edward Lee Elliott

Joe Corkery

Examples relating to calibrating an estimated gaze location are disclosed. One example method comprises monitoring the estimated gaze location of a viewer using gaze tracking data from a gaze tracking system. Image data for display via a display device is received, the image data comprising at least one target visual and target visual metadata that identifies the at least one target visual. The target visual metadata is used to identify a target location of the at least one target visual. The estimated gaze location of the viewer is monitored and a probability that the viewer is gazing at the target location is estimated. The gaze tracking system is calibrated using the probability, the estimated gaze location and the target location to generate an updated estimated gaze location of the viewer.

Gaze detection calibration

Embodiments are disclosed herein that relate to selecting user interface elements via a periodically updated position signal. For example, one disclosed embodiment provides a method comprising displaying on a graphical user interface a representation of a user interface element and a representation of an interactive target. The method further comprises receiving an input of coordinates of the periodically updated position signal, and determining a selection of the user interface element if a motion interaction of the periodically updated position signal with the interactive target meets a predetermined motion condition.

Selecting user interface elements via position signal

Examples relating calibrating an estimated gaze location are disclosed. One example method comprises monitoring the estimated gaze location of a viewer using gaze tracking data from a gaze tracking system. Image data for display via a display device is received and, without using input from the viewer, at least one target visual that may attract a gaze of the viewer and a target location of the target visual are identified within the image data. The estimated gaze location of the viewer is compared with the target location of the target visual. An offset vector is calculated based on the estimated gaze location and the target location. The gaze tracking system is calibrated using the offset vector.

Embodiments that relate to scaling a visual element displayed via a display device are disclosed. In one embodiment a method includes receiving and using gaze tracking data to determine gaze locations at which a user is gazing on the display device. Depth tracking data is received and used to determine that a user's pointer is at a predetermined location. In response, a locked gaze location on the screen is locked, where the locked gaze location includes at least a portion of the visual element. In response to locking the locked gaze location, the visual element is programmatically scaled by a predetermined amount to an enlarged size. A user input selecting the visual element is then received.

User interface programmatic scaling

Embodiments that relate to positioning a target indicator via a display system are disclosed. For example, one disclosed embodiment provides a method for positioning a target indicator using gaze tracking data having a coarse accuracy from a gaze tracking system of a computing device. Head pose data having a fine accuracy greater than the coarse accuracy is received from a head tracking system. Using the gaze tracking data, an approximate user gaze region within a display region is determined, and the target indicator is displayed at an initial location within the approximate user gaze region. A reposition input from the user is received. In response, subsequently received head pose data is used to calculate an adjusted location for the target indicator. The target indicator is then displayed at the adjusted location.

Target positioning with gaze tracking

Panoramic and spherical cameras often currently capture respective portions of a scene using a set of lenses that focus images on imagers for sampling by photosensitive elements. Because the images are often circular and imagers are often rectangular, the orientation of the lenses may be selected as a tradeoff between capturing capture the entire image while leaving unused portions of the imager, and maximizing imager coverage to increase resolution while creating cropped image portions that extend beyond the edges of the imager. The techniques presented herein involve displacing the image from the imager center in order to increase a first cropped area and reduce or eliminate a second cropped area. The lenses may also be oriented such that the first cropped area comprises a portion of the composite image that may be acceptable to omit from the composite image (e.g., the user's hand or a camera mounting apparatus).

Displacing image on imager in multi-lens cameras

Embodiments that relate to navigating a hierarchy of visual elements are disclosed. In one embodiment a method includes presenting one or more visual elements from a two-dimensional plane via a display device. A home location within a viewable region of the display is established. A proportional size relationship between each element and each of the other elements is established. Using gaze tracking data, a gaze location at which a user is gazing within the viewable region is determined. The gaze location is mapped to a target location, and movement of the target location toward the home location is initiated. As the target location moves closer to the home location, each of the visual elements is progressively enlarged while the proportional size relationship between each of the visual elements and each of the other visual elements is also maintained.

User interface navigation

A method of navigating items on a display on a computing device with a touch sensitive input device is disclosed. Similar to a bike wheel, the list of items will rotate in relation to the velocity of the input applied including speed up, slow down, stop and change directions.

Growing community of inventors

San Francisco, CA, United States of America

Morgan Kolya Venable