Google Inc.

Sushant Kulkarni

Idris S Aleem

Mayank Bhargava

Rees Anwyl Samuel Simmons

Ahmed Gawish

Gabriel Reyes

Samuel Legge

Samarth Singhal

Lee Payne

Angela Krone

A system and method of detecting display fit measurements and/or ophthalmic measurements for a head mounted wearable computing device including a display device is provided. An image of a fitting frame worn by a user of the computing device is captured by the user, through an application running on the computing device. One or more keypoints and/or features and/or landmarks are detected in the image including the fitting frame. A three-dimensional pose of the fitting frame is determined based on the detected keypoints and/or features and/or landmarks, and configuration information associated with the fitting frame. The display device of the head mounted wearable computing device can then be configured based on the three-dimensional pose of the fitting frame as captured in the image.

Image based detection of fit for a head mounted wearable computing device

A system and method of detecting display fit measurements and/or ophthalmic measurements for a head mounted wearable computing device including a display device is provided. An image of a fitting frame worn by a user of the computing device is captured by the user, through an application running on the computing device. One or more visual markers each including a distinct pattern are detected in the image including the fitting frame. A model of the fitting frame, and configuration information associated with the fitting frame, are determined based on the detection of the pattern. A three-dimensional pose of the fitting frame is determined based on the detected visual marker(s) and patterns, and the configuration information associated with the fitting frame. The display device of the head mounted wearable computing device can then be configured based on the three-dimensional pose of the fitting frame as captured in the image.

Image based detection of display fit and ophthalmic fit measurements

A wearable heads-up display (WHUD) obtains attribute data corresponding to an attribute of an item of interest and obtains environmental data of an environment surrounding the WHUD via one or more sensors of the WHUD. The WHUD compares the attribute data with the environmental data to detect the item of interest. In response to the detection, the WHUD obtains location data indicative of a location of the item of interest, stores the location data in association with a context of detection of the item of interest. In response to a trigger, such as a query by a user regarding the item of interest, the WHUD provides a location indication based on the location data, the location indication including, for example, a display of a description of the location of the item of interest, a display of the item of interest at the location, and the like.

Tracking of item of interest using wearable heads up display

Systems, devices, and methods for generating and sending messages are described. messages are autonomously generated by at least one processor by identifying environmental context of a device, system, or user, such that minimal input is required from the user. Environmental context can include at least time, date, calendar entries, user activity, location, physical environment, message history, and relationship between users. Messages can also be generated by generating a first portion of a message, and having the user select a second portion to complete the message. Recipients for a message can be autonomously determined based on environmental context and content of a message to be sent.

Growing community of inventors

Kitchener, Canada

Sushant Kulkarni