Fujitsu Corporation

Albert H M Reinhardt

David Loren Marvit

B Thomas Adler

Hitoshi Matsumoto

Jawahar Jain

Rajalakshmi Balakrishnan

Alexander Gilman

Bruce A Wilcox

Stergios Stergiou

Albert C Braun

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The gestures comprise symbol gestures each corresponding to a character from a preexisting character set. The device includes an application database maintaining at least one application and a gesture mapping database comprising a gesture input map for the application. The gesture input map comprises mappings of the symbol gestures to corresponding inputs for the application. The device includes a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a control module operable to load the application, to track movement of the handheld device using the motion detection module, to compare the tracked movement against the symbol gestures to identify a matching symbol gesture, to identify, using the gesture input map, the corresponding input mapped to the matching symbol gesture, and to provide the corresponding input to the application.

Gesture based user interface supporting preexisting symbols

In particular embodiments, a method includes accessing data streams from a first group of physiological sensors monitoring a person, a second group of deconfounding sensors monitoring the person, and a third group of sensors monitoring a stressor, analyzing data sets collected from the person when the person is exposed and not exposed to the stressor, and determining a current stress factor for the stressor with respect to the person based on the analysis.

Calculating and monitoring a composite stress index

In particular embodiments, a method includes accessing one or more physiological data streams, analyzing each physiological data stream in reference to a set of control parameters, and, if a data stream deviates from its control parameters, then transmitting a query to a mood sensor or a behavioral sensor.

Triggering user queries based on sensor inputs

In particular embodiments, a method includes accessing an original data stream from a sensor, associating a timestamp with each of the samples in the data stream based on a system clock, and recording the original data stream with the associated timestamps.

Data aggregation platform

In particular embodiments, a method includes accessing data streams from a mood sensor and one or more of a heart-rate monitor, a blood-pressure monitor, a pulse oximeter, or an accelerometer monitoring a person, analyzing data sets collected from the person when the person is stressed and unstressed, analyzing the data sets, and determining a current stress index of the person based on the analysis.

Continuous monitoring of stress using self-reported psychological or behavioral data

In particular embodiments, a method includes accessing data streams from an environmental sensor, and one or more of a mood sensor, a heart-rate monitor, a blood-pressure monitor, a pulse oximeter, or an accelerometer monitoring a person, analyzing data sets collected from the person when the person is exposed to various environmental states, and determining a current stress index of the person based on the analysis.

Continuous monitoring of stress using environmental data

A motion controlled handheld device includes a display having a viewable surface and operable to generate a current image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The device includes a gesture mapping database comprising a mapping of each of the gestures to an associated command, a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface and a display control module having a first mode of operation and a second mode of operation. The display control module is operable in the first mode of operation to monitor the motion of the device, to determine a location of the device resulting from the motion, and to modify the current image based on the resulting location of the device. The display control module is operable in the second mode of operation to monitor the motion of the device, to track movement of the handheld device using the motion detection module, to compare the tracked movement with the gestures to identify a matching gesture, to identify one of the commands associated with the matching gesture, and to modify the current image based on the identified command. The device also includes a mode selection module operable to detect a mode selection trigger and to switch between the first mode of operation and the second mode of operation in response to detecting the mode selection trigger.

Selective engagement of motion input modes

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of predefined gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The device includes an application having a plurality of predefined commands and a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device includes a user interface operable to receive user input associating selected ones of the gestures with corresponding ones of the commands and a gesture mapping database comprising a command map for the application. The command map comprises mappings of the selected gestures to the corresponding commands as indicated by the user input. The device also includes a control module operable to load the application, to track movement of the handheld device using the motion detection module, to compare the tracked movement against the gestures to determine a matching one of the gestures, to identify, using the command map, the command mapped to the matching gesture, and to perform the identified command using the application.

Customizable gesture mappings for motion controlled handheld devices

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The device includes a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a control module operable to identify a base reference position of the device, track movement of the device, using the motion detection module, to identify a potential gesture, compare the potential gesture against the gestures in the gesture database, and determine whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold.

Non-uniform gesture precision

A motion controlled handheld device includes a display having a viewable surface and operable to generate a current image. The device includes a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The components comprise a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface. The device also includes a display control module operable to display a cursor on the viewable surface, to determine a translation vector that is substantially opposite to the sum of the first component and the second component, and to translate the cursor across the viewable surface according to the translation vector in order to substantially maintain the position of the cursor in space with respect to the viewable surface.

Translation controlled cursor

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The device includes a plurality of applications each having a plurality of predefined commands and a gesture mapping database comprising a plurality of command maps. Each of the command maps corresponds to a particular one of the applications and maps each of the predefined commands to one of the gestures. The device includes a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a control module operable to load one of the applications, to select one of the command maps corresponding to the loaded application, to track movement of the handheld device using the motion detection module, to compare the tracked movement against the gestures to determine a matching gesture, to identify, using the selected command map, the predefined command mapped to the matching gesture, and to perform the identified command using the loaded application.

Context dependent gesture response

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The gesture database comprises a first gesture set and a second gesture set. The device includes a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a control module operable to track movement of the handheld device using the motion detection module, compare the tracked movement against the gestures in the first gesture set to determine matching gestures, monitor user precision in indicating the matching gestures, determine that the user precision exceeds a precision threshold, prompt the user to enable the second gesture set, and in response to an appropriate user command, enable the second gesture set such that the controller compares subsequent motion of the device against the gestures in the second gesture set.

Dynamic adaptation of gestures for motion controlled handheld devices

A motion controlled handheld device includes a display having a viewable surface and operable to generate a current image. The device includes a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a gesture database comprising a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device. The gestures comprise at least four planar gestures each defined by a motion vector generally aligned in parallel with the viewable surface. The device includes a gesture mapping database mapping each of the gestures to a corresponding command, the gesture mapping database mapping each of the four planar gestures to a corresponding grid navigation command. The device also includes a motion response module operable to identify a matching one of the planar gestures based on the motion and to determine the corresponding one of the grid navigation commands based on the identified planar gesture and a display control module operable to logically parse a viewable image into a plurality of grid sections, to set one of the grid sections as the current image, and to set another one of the grid sections as the current image in response to the determined grid navigation command.

Gesture based navigation of a handheld user interface

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The components comprise a first component parallel to the viewable surface, a second component parallel to the viewable surface and perpendicular to the first component, and a third component perpendicular to the viewable surface. The device includes a motion processing module operable to compare the components, to isolate a preferred one of the components based on the comparison, and to adjust a magnitude of the preferred component by an augmentation factor. The device also includes a motion response module operable to modify the image based on the augmented preferred component.

Growing community of inventors

San Francisco, CA, United States of America

Albert H M Reinhardt