Hewlett-packard Development Company, L.p.

Qualcomm Incorporated

Apple Inc.

Electronics for Imaging Gmbh

Intuitive Surgical Operations, Inc.

Ramin Samadani

Nicolas P Bonnier

John George Apostolopoulos

Mary G Baker

Ian N Robinson

Hui Chao

Mitchell D Trott

Tong Zhang

Ullas Gargi

Michael Harville

Amir Said

Thomas Malzbender

Teun R Baar

Christina G Gambacorta

Elijah H Kleeman

Suk Hwan Lim

Daniel R Tretter

Kar-Han Tan

Russel A Martin

Jonathan Marsden

Daniel George Gelb

Carlos Manuel Puig

Simon Widdowson

Yu-Yao Chang

Paul Stephen Drzaic

Ayman Fawzy Naguib

Qian Lin

Marc Albrecht

Radu Pitigoi-Aron

Jiaying Wu

Wai-Tian Tan

Pere Obrador

Huitao Luo

Jonathan Yen

Keith E Moore

Nelson Liang An Chang

Victor Kulik

Yin Chen

Yifan Zhang

Guo Li

Yining Deng

Mastooreh Salajegheh

Andrew J Patti

I-Jong Lin

Arvind Sundararajan

Ken Kengkuan Lin

Tobias Jung

Tae-Wook Koh

Mei Chen

Jonathan D Halderman

Justin McGloin

Ton Kalker

Gregory B Abbas

Kar Han Tan

Paul Michel

Zuo Xia

Farzad Parvaresh

Victor M De Araujo Oliveira

Dookun Park

Chen Wu

Justin Patrick Mcgloin

Russel Allyn Martin

A fluorescence imaging control system may direct an imaging system to detect, over a period of time, first fluorescence emitted from a first fluorescing region illuminated with fluorescence excitation illumination. The first fluorescing region includes a first population of fluorophores that emit the first fluorescence. The fluorescence imaging control system may also direct the imaging system to detect, over the period of time, second fluorescence emitted from a second fluorescing region illuminated with the fluorescence excitation illumination. The second fluorescing region includes a second population of fluorophores that emit the second fluorescence. The first fluorescing region photobleaches at a first photobleaching rate and the second fluorescing region photobleaches at a second photobleaching rate that is different than the first photobleaching rate. The fluorescence imaging control system may determine, based on the detected first fluorescence and second fluorescence, a measure of photobleaching of the first fluorescing region.

Systems and methods for determining a measure of photobleaching of a fluorescence target

An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

Image enhancement devices with gaze tracking

Described herein are devices, systems, and methods for illumination of a target that provide control over the beam divergence, beam shape, and/or direction of the illumination beam. Such illumination beam control may be based on images of the target, and may serve to direct light at one or more regions of interest.

Devices and methods for spatially controllable illumination

Systems, methods, and devices are provided to reduce a likelihood of image burn-in on an electronic display. Such an electronic device may include image processing circuitry and an electronic display. The image processing circuitry may receive image data and analyze the image data for risk of image burn-in and, based at least in part on the analysis of the image data, reduce a risk of image burn-in at least in part by reducing a local maximum pixel luminance value in at least one of a plurality of regions of the image data over time or by reducing a dynamic range headroom of the image data. The electronic display may display the image data with a reduced risk of image burn-in on the pixels of the electronic display.

Electronic display burn-in detection and mitigation

An electronic device may be provided with a display. A content generator such as a camera may capture images in high dynamic range mode or standard dynamic range mode. The images may have associated image metadata such as face detection information, camera settings, color and luminance histograms, and image classification information. Control circuitry in the electronic device may determine tone mapping parameters for the captured images based on the image metadata. The tone mapping parameters for a given image may be stored with the image in the metadata file. When it is desired to display the image, the control circuitry may apply a tone mapping process to the image according to the stored tone mapping parameters. The algorithm that is used to determine tone mapping parameters based on image metadata may be based on user preference data gathered from a population of users.

Tone mapping techniques for increased dynamic range

An electronic device may be provided with a display. Standard and high dynamic range content may be produced by content generators operating on control circuitry. Standard dynamic range content and high dynamic range content may be simultaneously displayed. Tone mapping parameters may be produced by a tone mapping engine for use in displaying the standard and high dynamic range content. The tone mapping parameters may be selected based on factors such as ambient light level, user brightness setting, content statistics, display characteristics, point of gaze information, power consumption information, and per-window information. Tone mapping parameters may be selected to accommodate simultaneous display of standard and high dynamic range content. Tone mapping parameters may be temporarily modified in response to a user's point of gaze switching between standard dynamic range content and high dynamic range content.

Electronic devices with dynamic control of standard dynamic range and high dynamic range content

A method performed by an electronic device is described. The method includes receiving a set of image frames. The set of image frames includes a face. The method also includes determining at least one facial motion of the face based on the set of image frames. The method further includes determining, based on the at least one facial motion, a facial rigidity confidence value indicating a degree of confidence that the face is rigid. The method additionally includes determining at least one facial micro-motion of the face based on the set of image frames. The method also includes determining a micro-motion matching confidence value indicating a degree of matching between the at least one facial micro-motion and a micro-motion profile. The method further includes authenticating a user based on the facial rigidity confidence value and the micro-motion matching confidence value.

Systems and methods for facial authentication

Methods, systems, computer-readable media, and apparatuses for estimating a user's heart rate using a PG signal are presented. In some implementations, the heart rate is estimated by computing a frequency-domain PG, identifying one or more features in the frequency-domain PG, selecting qualified features from the one or more features, and constructing one or more traces. In some implementations, an accelerometer signal can be used for motion cancellation to eliminate traces that are motion artifacts.

Estimating heart rate by tracking optical signal frequency components

Various implementations include unmanned autonomous vehicles (UAVs) and methods for providing security for a UAV. In various implementations, a processor of the UAV may receive sensor data from a plurality of UAV sensors about an object in contact with the UAV. The processor may determine an authorization threshold based on the received sensor data. The processor may determine whether the object is authorized based on the received sensor data and the determined authorization threshold.

Autonomous vehicle security

Implementations include systems and methods for managing security for a mobile communication device. In implementations, a processor of the mobile communication device may determine environment context information. The processor may receive safety information from one or more peer devices. The processor may determine an authentication requirement for the mobile communication device based on the received safety information and the determined environment context information. The processor may deny access to a function of the mobile communication device in response to determining that the determined authentication requirement is not satisfied.

Managing security for a mobile communication device

Disclosed is an apparatus and method for automatically configuring a mobile device for collecting and inferring heart rate data of a user. The method may include capturing heart rate data for a user with a heart rate sensor that is coupled with a mobile device. The method may also include monitoring a activity state of the user from activity data captured by the mobile device, and detecting a constant activity state of the user. The method may also include inferring heart rate data for the user from the captured heart rate data during a period in which the user remains in the constant activity state. The method may also include providing the inferred heart rate data, as captured heart rate data, to a heart rate calculator during the period in which the user remains in the constant activity state.

Methods and systems for reducing energy consumption of a heart rate monitor

A method performed by a processing system. The method includes generating silence signatures of audio signals from a plurality of device based on energy levels of the audio signals, providing the silence signatures to an interaction service, and outputting interaction information corresponding to the devices.

Silence signatures of audio signals

Disclosed embodiments pertain to the measurement of heart rate in the presence of motion and noise. Spectral peaks in measurements by an optical sensor are compared with spectral peaks obtained from a motion sensor signal measurements, to obtain a fundamental frequency in the optical sensor signal, where the fundamental frequency is associated with a user's heart rate. A first heart rate may be estimated based on the fundamental frequency. A variety of quality metrics may be determined for the first heart rate estimate. A second estimated heart rate may be determined based by processing a frequency domain representation of the optical sensor signal based on a frequency domain representation of the motion sensor signal. One or more of the previously determined quality metrics may be dynamically adjusted based on a comparison of first and second estimated heart rates.

Robust heart rate estimation

Growing community of inventors

Menlo Park, CA, United States of America

Ramin Samadani