Humane, Inc.

Hewlett-packard Development Company, L.p.

Kenneth Luke Kocienda

Imran A Chaudhri

Lilynaz Hashemi

Yanir Nulman

Adam Binsz

Jenna Arnost

George Kedenburg

Jane Koo

Eugene Bistolas

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device determines a plurality of points of interest and, for each of the points of interest, a heading of that point of interest relative to the device, and a distance between that point of interest and the device. The device presents a user interface including a plurality of user interface elements arranged according to one or more curved layers. Each of the user interface elements corresponds to a different one of the points of interest. A position of each of the user interface elements relative to each of the other user interface elements in the user interface is determined based on the first data and the second data.

Laser projected wayfinding interface

In an example method, a wearable multimedia device is worn by a user. Further, the device receives one or more communications during a first period of time; receives information regarding one or more events during the first period of time; receives a first spoken command from the user during a second period of time, where the second period of item is subsequent to the first period of time, and where the first spoken command includes a request to summarize the one or more communications and the one or more events; generates, using one or more of machine learning models, a summary of the one or more communications and the one or more events; and presents at least a portion of the summary to the user.

Electronic devices using object recognition and/or voice recognition to provide personal and health assistance to users

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device obtains sensor data from one or more first sensors of the wearable multimedia device, and generates a first content item based on the sensor data. Further, the device obtains biometric data regarding a user of the device. The biometric data is obtained from one or more second sensors of the wearable multimedia device. The device determines a metric for the first content item based on the biometric data, and stores the first content item and the metric. The metric is stored as metadata of the first content item.

Generating, storing, and presenting content based on a memory metric

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device obtains first configuration data specifying first operations associated with a first hand of a user of the wearable multimedia device, and second configuration data specifying second operations associated with a second hand of the user. Further, the device captures sensor data from a camera and/or a depth sensor of the wearable multimedia device, and determines a presence of the first hand and/or the second hand based on the sensor data. Further, the device performs at least one of (i) the first operations responsive to determining the presence of the first hand, or (ii) the second operations responsive to determining the presence of the second hand.

Hand-specific laser projected virtual interfaces and operations

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device projects a virtual interface (VI) on a surface using a laser projector. The VI includes a first user interface element and a second user interface element partially overlapping the first user interface element. The device detects, based on sensor data from at least one of a camera or a depth sensor of the wearable multimedia device, that a user has positioned a finger in proximity with the first user interface element. In response, the device modifies a visual characteristic of at least one of the first user interface element or the second user interface element.

Laser projected virtual interface

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device receives a first speech input from a user, including a first command to generate a message, and first content for inclusion in the message. The device determines second content for inclusion in the message based on the first content, and generates the message such that the messages includes the first and second content. The device receives a second speech input from the user, including a second command to modify the message. In response, the device determines third content for inclusion in the message based on the first content and/or the second content, and modifies the message using the third content. The device transmits the modified message to a recipient.

Composing electronic messages based on speech input

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and, in some implementations, a cloud computing platform. In some implementations, in a method for presentation of a home screen. In response to determining that a waking condition of a mobile device is satisfied, an environment of the mobile device is sensed using one or more sensors of the mobile device. Based at least on the sensing, a current context of the mobile device is determined. In response to determining the current context of the mobile device, a particular content is selected from among a plurality of content, the particular content being relevant to a user of the mobile device based on the current context of the mobile device. The particular content is presented as a home screen of the mobile device upon waking the mobile device.

Context-sensitive home screens for use with wearable multimedia devices

Systems, methods, devices and non-transitory, computer-readable storage media are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In some implementations, a first event data structure is obtained, the first event data structure including first content and a first label including a first plurality of nested categories. A second event data structure is obtained, the second event data structure including second content, and a second label including a second plurality of nested categories. The second label is different from the first label. A context of a mobile device is determined. At least one of the first content or the second content to present using the mobile device is determined. Using the mobile device, the at least one of the first content or the second content is presented.

Structuring and presenting event data for use with wearable multimedia devices

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing data captured by the wearable multimedia device. In an embodiment, operations performed by the wearable multimedia device or cloud computing platform include accessing information from one or more data streams, where the one or more data streams include at least one of image data or preset image parameters; determining, using the information from the one or more data streams, exposure parameters for capturing one or more images; applying the determined exposure parameters to a camera; and controlling the camera to capture one or more images with an exposure set according to the applied exposure parameters.

Automatic camera exposures for use with wearable multimedia devices

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing data captured by the wearable multimedia device. In an embodiment, operations performed by the wearable multimedia device or cloud computing platform include obtaining an image captured using a camera coupled to a wearable multimedia device; comparing the image to one or more known images; identifying one or more target features in the image; generating a new image comprising a portion of the image that includes the one or more target features; and providing the new image to the wearable multimedia device for presentation.

Displaying images using wearable multimedia devices

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device presents a user interface for composing a message. The device receives a first user input indicating a recipient of the message and first data for inclusion in the message. In response, the device presents at least the recipient and the first data in a first user interface element of the user interface. Further, subsequent to receiving the first user input, the device receives a second user input indicating a selection of a first application or service from a plurality of applications or services presented in a second user interface element of the user interface. Subsequently, the device transmits the message to the recipient using the first application or service.

Message composition interfaces for use with wearable multimedia devices

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device determines a projection area of a laser projector, the projection area having an inner region and a border region at least partially enclosing the inner region. Further, the device projects, using the laser projector, a virtual interface (VI) on a surface. In particular, the device determines, based on sensor data from a camera and/or a depth sensor, a position of the surface relative to the projection area. Further, the device projects the VI on the surface based on the position of the surface. Further, the device determines that a portion of the VI coincides with the border region, and in response, modifies a visual appearance of that portion.

Growing community of inventors

Mill Valley, CA, United States of America

Kenneth Luke Kocienda