Georgia Tech Research Corporation

University of Washington

Belkin International, Inc.

Gregory D Abowd

Shwetak N Patel

Matthew Stephen Reynolds

Thomas M Robertson

Thad Eugene Starner

Erich Peter Stuntebeck

Zhong Lin Wang

Steven L Zhang

Yi-Cheng Wang

Qiuyue Xue

Seyedeh Fereshteh Shahmiri

Cheng Zhang

Emmanouil Tentzeris

Omer T Inan

Thomas Ploetz

Mohit Gupta

Ryan Bahr

Diego Osorio

Nivedita Arora

Anandghan Waghmare

Dhruva Bansal

Peter McAughan

Zhengjun Wang

James Rehg

Nicholas Lane

Khai N Truong

Kenneth A Cunnefare

Hyeokhyen Kwon

Sebastian Boring

Harish Kashyap Haresamudram

Eu Gen Catherine Tong

Yan Gao

Chaoyu Chen

Shivan Mittal

Dingtian Zhang

Pranav Kundra

Yiming Pu

Xiaoxuan Wang

Julie Kientz

Ping Wang

Sangmin Oh

Karthir Prabhakar

Junrui Yang

An exemplary virtual IMU extraction system and method are disclosed for human activity recognition (HAR) or classifier system that can estimate inertial measurement units (IMU) of a person in video data extracted from public repositories of video data having weakly labeled video content. The exemplary virtual IMU extraction system and method of the human activity recognition (HAR) or classifier system employ an automated processing pipeline (also referred to herein as 'IMUTube') that integrates computer vision and signal processing operations to convert video data of human activity into virtual streams of IMU data that represents accelerometer, gyroscope, or other inertial measurement unit estimation that can measure acceleration, inertia, motion, orientation, force, velocity, etc. at a different location on the body. In other embodiments, the automated processing pipeline can be used to generate high-quality virtual accelerometer data from a camera sensor.

Method and system for automatic extraction of virtual on-body inertial measurement units

Disclosed herein is a flexible sensing interface, comprising: a sensor, comprising: a core; an inner electrode in the form of a conductive material in contact with the core; an inner dielectric material substantially encasing the inner electrode; an outer electrode in the form of a conductive material in contact with the inner dielectric material and in electrical communication with the inner electrode; and an outer dielectric material substantially encasing the outer electrode; wherein the inner dielectric material and the outer dielectric material comprise an elastic material. Also disclosed herein are systems and methods for making and using the same.

Flexible sensing interface systems and methods

A method including receiving sound data captured by a wearable device of the user, the sound data indicative of contact between a first portion of the user wearing the wearable device and a second portion of the user wearing the wearable device; receiving motion data captured by the wearable device of the user, the motion data indicative of at least a movement of the first portion of the user wearing the wearable device; and determining, by a processor, based at least in part on the sound data and the motion data, a user input associated with the contact between a first portion of the user wearing the wearable device and a second portion of the user wearing the wearable device and the movement of the first portion of the user wearing the wearable device.

Systems, methods and devices for gesture recognition

A vibration transducer for sensing vibrations includes a first flexible triboelectric member, a second flexible triboelectric member, a plurality of attachment points, a first electrode and a second electrode. The first flexible triboelectric member includes a first triboelectric layer and a material being on a first position on a triboelectric series. A conductive layer is deposited on the second side thereof. The second flexible triboelectric member includes a second triboelectric layer and a material being on a second position on the triboelectric series that is different from the first position on the triboelectric series. The second triboelectric member is adjacent to the first flexible triboelectric member. When the first triboelectric member comes into and out of contact with the second triboelectric member as a result of the vibrations, a triboelectric potential difference having a variable intensity corresponding to the vibrations can be sensed between the first and second triboelectric members.

Thin and flexible self-powered vibration transducer employing triboelectric nanogeneration

A portable electronic device including: a plurality of sensors configured to generate, in response to a first contact with a body of a user in a vicinity of the portable electronic device, one or more first input signals; a microprocessor; and a memory having stored thereon instructions that, when executed by the microprocessor, control the microprocessor to execute, in response to an analysis of the one or more first input signals indicating that the first contact corresponds to a first gesture, and by the microprocessor, a first command corresponding to the first gesture.

Electronic device and method of controlling same

Activity sensing in the home has a variety of important applications, including healthcare, entertainment, home automation, energy monitoring and post-occupancy research studies. Many existing systems for detecting occupant activity require large numbers of sensors, invasive vision systems, or extensive installation procedures. Disclosed is an approach that uses a single plug-in sensor to detect a variety of electrical events throughout the home. This sensor detects the electrical noise on residential power tines created by the abrupt switching of electrical devices and the noise created by certain devices while in operation. Machine learning techniques are used to recognize electrically noisy events such as turning on or off a particular light switch, a television set, or an electric stove. The system has been tested to evaluate system performance over time and in different types of houses. Results indicate that various electrical events can be learned and classified with accuracies ranging from 85-90%.

Detecting actuation of electrical devices using electrical noise over a power line

A portable electronic device having improved user input capabilities and methods for controlling the same are provided. The device includes sensors capable of detecting and classifying user inputs provided as gestures performed on a surface of the device, wherein the surface does not include the sensors for detection of the gesture, nor is the surface in direct communication with the sensors for detection of the gesture. The device includes a microprocessor that performs instructions in response to the provided user input gestures.

Extending interactions of a portable electronic device

Disclosed is a system that uses existing power line infrastructure in a building as a distributed reception antenna capable of receiving signals from very low-power wireless sensors, thus allowing these sensors to be detected at ranges that are otherwise impractical with over-the-air reception. Also disclosed is a wireless sensor platform that is able to be sensed throughout a building with very low current draw. The disclosed technique may also be utilized to extend the range of mid-frequency consumer electronic devices by leveraging the power line as a reception antenna.

Method and apparatus for using in-home power lines to support low power wireless sensors and to extend the range of low-power wireless devices

Activity sensing in the home has a variety of important applications, including healthcare, entertainment, home automation, energy monitoring and post-occupancy research studies. Many existing systems for detecting occupant activity require large numbers of sensors, invasive vision systems, or extensive installation procedures. Disclosed is an approach that uses a single plug-in sensor to detect a variety of electrical events throughout the home. This sensor detects the electrical noise on residential power lines created by the abrupt switching of electrical devices and the noise created by certain devices while in operation. Machine learning techniques are used to recognize electrically noisy events such as turning on or off a particular light switch, a television set, or an electric stove. The system has been tested to evaluate system performance over time and in different types of houses. Results indicate that various electrical events can be learned and classified with accuracies ranging from 85-90%.

In some embodiments, a motion detecting device is configured to detect whether one or more movement events have occurred. The motion detecting device can include: (a) a processing module configured to run on a computational unit; and (b) a sensing device having: (1) one or more pressure sensors configured to provide two or more pressure measurements; and (2) a transmitter electrically coupled to the one or more pressure sensors and configured to transmit the two or more pressure measurements to the computational unit. The processing module is configured to use the two or more pressure measurements to determine whether the one or more movement events have occurred. The sensing device can be configured to be placed in at least one of ductwork of a heating, ventilation, and air conditioning system or an air handler of the heating, ventilation, and air conditioning system. Other embodiments are disclosed.

Motion detecting device, method of providing the same, and method of detecting movement

A method for providing improved performance in retrieving and classifying causal sets of events from an unstructured signal can comprise applying a temporal-causal analysis to the unstructured signal. The temporal-causal analysis can comprise representing the occurrence times of visual events from an unstructured signal as a set of point processes. An exemplary embodiment can comprise interpreting a set of visual codewords produced by a space-time-dictionary representation of the unstructured video sequence as the set of point processes. A nonparametric estimate of the cross-spectrum between pairs of point processes can be obtained. In an exemplary embodiment, a spectral version of the pairwise test for Granger causality can be applied to the nonparametric estimate to identify patterns of interactions between visual codewords and group them into semantically meaningful independent causal sets. The method can further comprise leveraging the segmentation achieved during temporal causal analysis to improve performance in categorizing causal sets.

Systems and methods for retrieving causal sets of events from unstructured signals

Motion detecting method and device

Growing community of inventors

Atlanta, GA, United States of America

Gregory D Abowd