Amazon Technologies, Inc.

Microsoft Technology Licensing, LLC

Marc Anthony Salazar

Jae Pum Park

Charles Cummins

Timothy Thomas Gray

Bryan Todd Agnetta

Suzan Marashi

Richard Leigh Mains

Sean Anthony Rooney

Steven Michael Sommer

Brian Peter Kralyevich

Nino Yuniardi

Russell E Glaser

Theodore Aaron Haberman

Sogol Malekzadeh

Cara Lyn Tyler

Catherine Ann Hendricks

Angela Kathleen Warren

Tito Pagan

Aaron Michael Donsbach

Chad Michael Roberts

Chad A Voss

Jason Glenn Silvis

Blair Harold Beebe

Vibhunandan Gavini

Sarah Siritaratiwat

Forrest Elliott

Santhosh Kumar Paraliyil Krishnankutty

Garret Martin Miller Graaf

Venkata Nagesh Babu Balivada

Joseph Robert Buchta

Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Mobile device applications

Mobile device interfaces

A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Recognition interfaces for computing devices

A computing device can include a recognition mode interface utilizing graphical elements, such as virtual fireflies, to indicate recognized or identified objects. The fireflies can be animated to move across a display, and the fireflies can create bounding boxes around visual representations of objects as the objects are recognized. In some cases, the object might be of a type that has specific meaning or information to be conveyed to a user. In such cases, the fireflies might be displayed with a particular size, shape, or color to convey that information. The fireflies also can be configured to form shapes or patterns in order to convey other types of information to a user, such as where audio is being recognized, light is sufficient for image capture, and the like. Other types of information can be conveyed as well via altering characteristics of the fireflies.

Adjusting graphical characteristics for recognition interfaces

A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies, to indicate recognized or identified objects. Fireflies can be displayed near an input element to indicate that a recognition mode is available. When a user selects the input element, the fireflies can appear to emanate from the input element and disperse across the display screen. As objects are recognized, fireflies can create bounding boxes around those objects, or otherwise appear proximate those objects, to indicate recognition. The fireflies can again disperse as the objects fall out of view, and can begin moving towards new objects as features of those objects are identified as potential object features. A subsequent selection of the input element to exit recognition mode can cause the fireflies to appear to retreat to their original location in, or near, the input element.

Graphical behaviors for recognition interfaces

Display screen with icon

Display screen with a set of icons

Growing community of inventors

Seattle, WA, United States of America

Marc Anthony Salazar