Snap Inc.

Stephen Pomes

Yu Jiang Tham

Jonathan M Rodriguez, Ii

Nir Daube

Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.

Selectively activating a handheld device to control a user interface displayed by a wearable device

Eyewear having a light array and vibration sensors for indicating to a user when to turn left and right, such as when the eyewear is operating a navigation map application, that improves the user experience of eyewear devices for users having partial blindness or complete blindness. To compensate for partial blindness, the front portion of the eyewear frame, such as the bridge, may include the light array, where the left portion of the light array is illuminated to indicate to the user to turn left. The right portion of the light array is illuminated to indicate to the user to turn right. To compensate for complete users having complete blindness, the eyewear has a vibration device on each side of the eyewear, such as in the temples, which selectively vibrate to indicate when the user should turn left and right.

Navigation assistance for the visually impaired

Eyewear having a light array and vibration sensors for indicating to a user when to turn left and right, such as when the eyewear is operating a navigation map application, that improves the user experience of eyewear devices for user's having partial blindness or complete blindness. To compensate for partial blindness, the front portion of the eyewear frame, such as the bridge, may include the light array, where the left portion of the light array is illuminated to indicate to the user to turn left. The right portion of the light array is illuminated to indicate to the user to turn right. To compensate for complete user's having complete blindness, the eyewear has a vibration device on each side of the eyewear, such as in the temples, which selectively vibrate to indicate when the user should turn left and right.

An eyewear device with camera-based compensation that improves the user experience for user's having partial blindness or complete blindness. The camera-based compensation determines features, such as objects, and then converts the determined objects to audio that is indicative of the objects and that is perceptible to the eyewear user. The camera-based compensation may use a region-based convolutional neural network (RCNN) to generate a feature map including text that is indicative of objects in images captured by a camera. The feature map is then processed through a speech to audio algorithm featuring a natural language processor to generate audio indicative of the objects in the processed images.

Wearable speech input-based vision to audio interpreter

An eyewear device with camera-based compensation that improves the user experience for user's having partial blindness or complete blindness. The camera-based compensation determines objects, converts determined objects to text, and then converts the text to audio that is indicative of the objects and that is perceptible to the eyewear user. The camera-based compensation may use a region-based convolutional neural network (RCNN) to generate a feature map including text that is indicative of objects in images captured by a camera. Relevant text of the feature map is then processed through a text to speech algorithm featuring a natural language processor to generate audio indicative of the objects in the processed images.

Blindness assist glasses

An eyewear device that adjusts aspects of a displayed object as a function of a user's eyeglass prescription. A detector identifies object edges for displayed far objects. A correction chart stores brightness corrections as a function of eyeglass prescriptions. The object edges are brightened as a function of the brightness corrections to sharpen objects displayed for a user with nearsightedness and/or farsightedness.

Digital glasses having display vision enhancement

Eyewear having a light array and vibration sensors for indicating to a user the direction and distance of an object relative to the eyewear to help a user understand and avoid objects. To compensate for partial blindness, the front portion of the eyewear frame may include the light array, where one or more lights of the light array is illuminated to indicate a corresponding direction of a proximate object. The relative brightness of the one or more lights indicates how close the object is, where brighter light(s) indicates a close object. To compensate for more severe partial blindness or complete blindness, the eyewear has haptics, such as a plurality of vibration devices on the front portion of the eyewear, such as in the bridge, which selectively vibrate to indicate a direction of the object. The stronger the vibration, the closer the object.

Growing community of inventors

Santa Monica, CA, United States of America

Stephen Pomes