Facense Ltd.

Arie Tzvieli

Gil Thieberger

Ari M Frank

Ori Tzvieli

Tal Thieberger-Navon

Due to the many interactions that can occur in places of gatherings, such as workplaces, schools, theaters, etc., these locations can be considered dangerous to enter during times of epidemics. It is difficult to keep track of the health state of all the people who visited a location, and thus ascertain if visits to the location pose any risk of contracting a disease. Some embodiments disclosed herein utilize wearable devices that measure physiological signals of their wearer in order to determine whether people who were at a location were healthy, and thus be able to certify the location as contagion-safe.

Wearable-based certification of a premises as contagion-safe

Disclosed herein is a doorway that facilitates passage from an inside to an outside, and which includes a barrier that moves between opened and closed positions based on commands sent by a computer. Sensors measure signals indicating whether a first user is on the outside, and whether a second user on the inside. The computer detects that the first user is on the outside and receives, from a device of the first user, an indication indicating the first user is healthy. The computer detects whether the second user is on the inside, and commands the barrier to move to the opened position if: (i) the second user is not on the inside, or (ii) the second user is on the inside and the computer receives, from a device of the second user, an indication indicating the second user is healthy.

Doorway system that utilizes wearable-based health state verifications

Described herein are embodiments of systems and methods that utilize images of a user's face to detect alcohol intoxication. One embodiment of a system to detect alcohol intoxication includes first and second inward-facing head-mounted cameras that are located less than 5 cm from a user's face, are sensitive to wavelengths below 1050 nanometer, and are configured to capture images of respective first and second regions on the user's face. The system also includes a computer that calculates, based on baseline images captured with the cameras while the user was not intoxicated, a baseline pattern of hemoglobin concentrations at regions on the face. The computer also calculates, based on a current set of images captured with the cameras, a current pattern of hemoglobin concentrations at the regions, and detects whether the user is intoxicated based on a deviation of the current pattern from the baseline pattern.

Detecting alcohol intoxication from video images

Embodiments disclosed herein involve a wearable-based system that can help determine in a privacy-preserving manner whether a user is healthy (and thus poses low risk of contagiousness), and use determinations of this nature to grant passage through a doorway. In one embodiment, a wearable device takes measurements of a user comprising a photoplethysmogram signal (PPG signal) and a temperature measurement. A computer calculates a health score based on a difference between baseline measurements of the user, measured one or more days earlier, and more current measurements of the user. Additionally, the computer calculates an extent of similarity between characteristics of the PPG signal in the current measurements and characteristics of the PPG signal in the baseline measurements. The computer authorizes the user's passage through the doorway responsive to the health score reaching a first threshold and the extent of the similarity reaching a second threshold.

Wearable-based health state verification for physical access authorization

Disclosed herein is utilization of photosensor-oculography along with a video camera to implement a novel form of eye tracking, which can be important for many applications, such as augmented reality (AR) on smartglasses. In one embodiment, an eye tracking system includes a photosensor-oculography device (PSOG) that emits light and takes measurements of reflections of the light from an eye of a user, and a camera that captures images of the eye. A computer calculates values indicative of eye movement velocity (EMV) based on the measurements of the reflections obtained by the PSOG. These values then are used to determine how data is read from the camera, which can save power in some cases: the computer reads data from the camera at a higher bitrate when the values are indicative of the EMV are below a threshold compared to when the values are indicative of the EMV are above the threshold.

Controlling an eye tracking camera according to eye movement velocity

Disclosed herein is robust detection of facial expressions that accounts for interferences on the face. In one embodiment, a system includes a head-mounted device that comprises (i) light sources configured to emit light towards a first region on a user's face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. Additionally, the system includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, an extent of presence of hair over a portion of the first region. Optionally, the computer calculates extents of other interferences such as perspiration, applied makeup, and skin infection. The computer then detects facial expressions of the user based on the measurements of the reflections and the calculated extent of the hair and/or other interferences.

Robust photosensor-based facial expression detector

A novel design for untethered smartglasses with wireless connectivity in which electronic components and electric wiring are mounted in a manner than enables at least a portion of temples of the smartglasses to be bent around the ear to improve the smartglasses' fit. In one embodiment, the smartglasses include a front element that supports lenses and two temples, coupled to the front element through hinges that enable folding and unfolding. At least one of the temples includes: a first portion coupled to the front element with first electronic components, a second portion coupled to the first portion with electric wires, and a third portion coupled to the second portion with second electronic components. The second portion is designed to be bent around a human ear to improve the smartglasses' fit, and the first and third portions are not designed to be bent to improve the smartglasses' fit.

Smartglasses with bendable temples

Described herein are embodiments of systems and methods that utilize temperature measurements taken with head-mounted sensors as well as images of a user's face to detect fever and/or intoxication. One embodiment of a system to detect fever includes a first head-mounted temperature sensor that measures skin temperature (T) at a first region on a user's head, a second head-mounted temperature sensor that measures a temperature of the environment (T), and a computer. The computer receives images of a second region on the user's face, captured by a camera sensitive to wavelengths below 1050 nanometer, and calculates, based on the images, values indicative of hemoglobin concentrations at three or more regions on the user's face. The computer can then detect whether the user has a fever based on T, Tand the values.

Detecting fever from images and temperatures

Described herein are embodiments of systems and methods that utilize images of a user's face to detect fever and intoxication. One embodiment of a system to detect fever includes first and second inward-facing head-mounted cameras that are located less than 5 cm from a user's face, are sensitive to wavelengths below 1050 nanometer, and are configured to capture images of respective first and second regions on the user's face. The system also includes a computer that calculates, based on baseline images captured with the cameras while the user did not have a fever, a baseline pattern of hemoglobin concentrations at regions on the face. The computer also calculates, based on a current set of images captured with the cameras, a current pattern of hemoglobin concentrations at the regions, and detects whether the user has a fever based on a deviation of the current pattern from the baseline pattern.

Detecting fever from video images and a baseline

Described herein are embodiments of systems and methods for calculating glucose in a non-invasive manner using head-mounted sensors. In one embodiment, a system that calculates blood glucose levels includes a head-mounted contact photoplethysmography device that measures a signal indicative of a photoplethysmogram signal (PPG signal) at a first region comprising skin on a user's head, and a head-mounted camera configured to capture images of a second region comprising skin on the user's head. The system also includes a computer that identifies, based on the PPG signal, times of systolic notches and times of systolic peaks, and calculates the blood glucose level based on differences between a first subset of the images taken during the times of systolic notches and a second subset of the images taken during the times of systolic peaks. Optionally, the photoplethysmography device and the camera are couple to smartglasses worn on the user's head.

Monitoring blood sugar level with a comfortable head-mounted device

Systems and methods for detecting an occurrence of a transient ischemic attack (TIA). In one embodiment, a device is utilized to measure first and second signals indicative of photoplethysmogram signals at first and second regions on the left and right sides of a user's head (PPGand PPG, respectively). A computer detects the occurrence of a TIA based on PPGand PPGthat exhibit a pattern that involves the following: (i) an asymmetry between PPGand PPG, which is below a threshold, during a first period spanning more than a day; (ii) an asymmetry between PPGand PPG, which exceeds the threshold, during a second period following the first period and spanning between 5 and 180 minutes; and (iii) an asymmetry between PPGand PPG, which falls below the threshold, during a third period following the second period.

Detecting a transient ischemic attack using photoplethysmogram signals

A hygienic in-vehicle head-mounted display (HMD) includes: a head piece, a stiff module, and a lock that connects and disconnects the head piece and the stiff module. The head piece is in direct physical contact with the passenger's face. The stiff module includes a display module that projects video into eyes of a passenger of a vehicle while the HMD is worn by the passenger. In one embodiment, a storage module may be used to stow the stiff module. Optionally, the storage module releases the stiff module responsive to the head piece being connected to the stiff module. In another embodiment, a processor instructs the display module to project video responsive to an indication that the head piece and the stiff module are connected, and instructs the display module not to project the video, responsive to an indication that the head piece and the stiff module are not connected.

Hygienic head-mounted display for vehicles

Head-mounted displays (HMDs) are being used more and more for entertainment and work while traveling in vehicles. However, the use of an HMD can be risky in the event of a collision. This disclosure describes a safety system comprising a head-mounted display (HMD) configured to be worn on a passenger's head while traveling in an automated on-road vehicle, a folded airbag, fixed to the HMD, and an inflation system fixed to the vehicle and connected to the folded airbag through a flexible hose. The flexible hose is configured to convey as generated by the inflation system. The system may further detach the flexible hose from the inflation system after the inflation, such that the airbag is no longer connected to the inflation system shortly after the inflation.

Head-mounted display having an inflatable airbag

Detecting a respiratory tract infection (RTI) based on changes in coughing sounds, which can provide an early warning of infection with a disease like COVID-19, as well as indications of its progression and severity. In one embodiment, the system includes smartglasses, with sensors mounted thereto, which include an acoustic sensor mounted at a fixed position relative to a user's head, and a movement sensor. A computer receives current measurements of the user, taken with the sensors, while there were head movements that characterize coughing, and also earlier measurements of the user, taken with the sensors, while the user had a known extent of the RTI and while there were head movements that characterize coughing. The computer detects a change relative to the known extent of the RTI based on a difference between the current measurements and the earlier measurements.

Detecting respiratory tract infection based on changes in coughing sounds

Disclosed herein are systems and methods for detecting a physiological response using different types of photoplethysmography sensors. Examples of physiological responses that may be detected include an allergic reaction, a stroke, a migraine, stress, certain emotional responses, manifestation of pain, and blood pressure. In one embodiment, a head-mounted contact photoplethysmography device measures a signal indicative of photoplethysmogram signal at a first region that includes exposed skin on a user's head (PPG signal). A camera, located more than 10 mm away from the user's head, captures images of a second region that includes exposed skin on the user's head. A computer detects the physiological response based on: (i) imaging photoplethysmogram signals (iPPG signals) recognizable in the images, and (ii) correlations between the PPG signal and the iPPG signals.

Growing community of inventors

Berkeley, CA, United States of America

Arie Tzvieli