Samsung Electronics Co., Ltd.

Nec Corporation

Korosh Vatanparvar

Jilong Kuang

Md Mahbubur Rahman

Viswam Nathan

Ebrahim Nematihosseinabadi

Jun Gao

Tousif Ahmed

Ratnesh Kumar Sharma

Li Yan Zhu

Mohsin Ahmed

Migyeong Gwak

Wenchuan Wei

Jun (Alex) Gao

Nazir Saleheen

Md Juber Rahman

Soujanya Chatterjee

Pulmonary assessment based on speech can include identifying one or more audio features and speech patterns of a user's speech. A cognitive burden associated with the user's speech can be determined. A pulmonary condition of the user can be determined based on predetermined correlations between the one or more audio features and speech patterns of the user's speech, the cognitive burden, and a respiratory airway condition.

Speech-based pulmonary assessment

A multimodal, contactless vital sign monitoring system is configured to perform the following operations. Images are received from a video capture device. An image of a subject is identified within the images. The image of the subject is segmented into a plurality of segments. A first analysis is performed on the plurality of segments to identify a color feature. A second analysis is performed of the plurality of segments to identify a motion feature. Using a combination of the color feature and the motion feature a plurality of vital signs for the subject are determined. The first analyzing and the second analyzing are performed in parallel. The plurality of vital signs include one or more of heart rate, respiration rate, oxygen saturation, heart rate variability, and atrial fibrillation.

Multimodal contactless vital sign monitoring

A method includes receiving, by an electronic device, sensor data during a spirometry test of a user, the sensor data comprising audio data of the user, image data of a face of the user, and distance data of a distance from the face of the user. The method also includes obtaining, by the electronic device, at least one measured parameter associated with the spirometry test that is determined using at least one of the audio data, the image data, or the distance data, wherein the at least one measured parameter is correlated with an amount of air volume exchange or an amount of exhalation force by the user during the spirometry test. The method further includes providing, by the electronic device, real time feedback during the spirometry test, the real time feedback based on the at least one measured parameter, the real time feedback indicating whether or not the user is performing the spirometry test correctly.

System and method for conducting on-device spirometry test

Pulmonary function estimation can include detecting one or more cough events from a time series of audio signals generated by an electronic device of a user. Based on the one or more cough events, one or more lung function metrics of the user can be determined.

Pulmonary function estimation

In particular embodiments, a method includes accessing, by a computing device, sensor data from a sensor of a client device corresponding to a user. The method further includes determining one or more segments of sensor data and selecting at least one segment of sensor data. The method further concludes determining, based at least on the selected segments of sensor data, one or more features corresponding to the user's pulmonary condition. The method further includes determining, based at least on the determined features, an assessment of the user's pulmonary condition.

Methods and systems for pulmonary condition assessment

A method includes receiving, by an electronic device, sensor data during a spirometry test of a user, the sensor data comprising audio data of the user and distance data of a distance from a face of the user to the electronic device. The method also includes obtaining, by the electronic device, an amount of air volume exchange and at least one pulmonary health parameter that are determined based on the audio data and the distance data. The method also includes presenting an indicator on a display of the electronic device for use by the user or a medical provider, the indicator representing the amount of air volume exchange.

A method includes obtaining, by an electronic device, an audio segment comprising one or more audio events of a target subject. The method also includes extracting, by the electronic device, audio embeddings from the one or more audio events using an embedding model, the embedding model comprising a trained machine learning model. The method further includes comparing, by the electronic device, the extracted audio embeddings with a match profile of the target subject, the match profile generated during an enrollment stage. The method also includes generating, by the electronic device, a label for the audio segment based on whether or not the extracted audio embeddings match the match profile, wherein the label enables correlation of the audio segment with the target subject for monitoring a health condition of the target subject.

System and method for passive subject specific monitoring

Adaptive respiratory condition assessment can include capturing signals generated by sensors of a portable device positioned to sense a user's body. The sensors can generate the signals in response to sensor-detected movements of the user's body measured along multiple axes and corresponding to lung activity in the user's body during respiratory cycles. A preferred axis of measurement can be selected using signal processing performed by a signal processor embedded in the portable device. Waveforms generated from signals corresponding to signals generated in response to movements of the user's body measured along the preferred axis can be filtered for extracting biomarkers from the waveforms using the signal processor. The one or more biomarkers extracted correspond to the lung activity. Based on the biomarkers, a respiratory condition of the user can be determined. A notification based on the respiratory condition as determined can be generated and conveyed with the portable device.

Adaptive respiratory condition assessment

A method for pulmonary condition monitoring includes selecting a phrase from an utterance of a user of an electronic device, wherein the phrase matches an entry of multiple phrases. At least one speech feature that is associated with one or more pulmonary conditions within the phrase is identified. A pulmonary condition is determined based on analysis of the at least one speech feature.

System and method for pulmonary condition monitoring and analysis

A method includes identifying, by an electronic device, one or more segments within a first audio recording that includes one or more non-speech segments and one or more speech segments. The method also includes generating, by the electronic device, one or more synthetic speech segments that include natural speech audio characteristics and that preserve one or more non-private features of the one or more speech segments. The method also includes generating, by the electronic device, an obfuscated audio recording by replacing the one or more speech segments with the one or more synthetic speech segments while maintaining the one or more non-speech segments, wherein the one or more synthetic speech segments prevent recognition of some content of the obfuscated audio recording.

System and method for continuous privacy-preserved audio collection

Systems and methods for power management include determining a demand threshold by solving an optimization problem that minimizes peak demand charges and maximizes a usable lifetime for a power storage system. Power is provided to a load from an electrical grid when the load is below the demand threshold and from a combination of the electrical grid and the power storage system when the load is above the demand threshold.

Growing community of inventors

Santa Clara, CA, United States of America

Korosh Vatanparvar