International Business Machines Corporation

Jenna Reinen

Aldis G Sipolins

Hui Wu

Ravi Tejwani

Marco Cavallo

Patrick D Watson

Rajeev Narayanan

Bing Dang

Joseph N Kozhaya

Jeffrey L Rogers

Ryan R Anderson

Bo Wen

Erhan Bilal

Rachel Ostrand

A method, computer system, and a computer program product are provided for testing functional mobility and memory. Information is about a participant to an artificial intelligence (AI) engine and then instructions are provided to the participant to memorize a random set of steps. The participant is then asked to recall the random set of instruction steps and then to perform the steps memorized. The participant is asked to recall the steps again after the physical performance. The result of the test is analyzed and a final participant assessment is rendered based on the overall performance analysis. The participant is provided instructions and further monitored and recorded for the performance of the test using smart devices, video or similar means.

Remote concurrent assessment of functional mobility and working memory

In an approach to monitoring and querying autobiographical events, one or more computer processors receive data from one or more sensors associated with a user. Based on the received data from the one or more sensors, one or more computer processors detect an autobiographical event associated with the user. One or more computer processors convert the received data from the one or more sensors into one or more observations associated with the autobiographical event. One or more computer processors convert the one or more observations into one or more questions associated with the one or more observations. One or more computer processors query the user with the one or more questions. One or more computer processors receive at least one response to the one or more questions from the user.

Monitoring and querying autobiographical events

A system includes a virtual reality system configured to enable a user to interact with a virtual environment, a plurality of biofeedback sensors configured to monitor a user, and a computer system including a virtual reality module configured to generate at least a view of the virtual environment, a biofeedback module configured to fuse output of the plurality of biofeedback sensors with a plurality of events within the virtual environment, a training module configured to generate a model of user behavior, wherein the training module executed by the computer system enables the computer system to make a prediction of a user response of the user based on a corpus of biofeedback data, and an alert module configured to generate at least one alert to the user via the virtual reality system based on the user response predicted by the computer system.

Building a model based on responses from sensors

A method includes detecting an eye movement of a reader during a reading of presented text; determining, based on whether an eye movement is detected, whether the reader is looking at the presented text; pausing a presentation of the presented text if it is determined that the reader is not looking at the presented text; and resuming, if the presentation of the text is paused, the presentation of the presented text.

Enhanced speed reading with eye tracking and blink detection

A sleeping mask includes a signal processor for processing sensor data, an infrared light source coupled to the signal processor and configured to emit infrared light toward an eyelid of a user, and an array of infrared sensors coupled to the signal processor and configured to receive infrared light reflected from the eyelid of the user.

Sleeping mask methods and panels with integrated sensors

A method, a structure, and a computer system for cardiorespiratory monitoring via rapid eye movement. The method comprises detecting eye movement of a user while asleep and determining whether the user is subject to a cardiorespiratory condition based on comparing the detected eye movement to a model.

Measuring rapid eye movement for cardiorespiratory monitoring

A data presentation method through augmented reality, system, and computer program product include creating a file container for a presentation that supports raw data embedding and definition of available interactions and levels of confidentiality of information for the presentation, streaming presentation content from the file container to a plurality of augmented reality devices, and generating a personalized individual interactive experience of the presentation content for at least one person wearing an augmented reality device in the plurality of augmented reality devices.

Personalized interactive data presentation through augmented reality

Systems, computer-implemented methods, and computer program products to generate virtual motion sensor data from computer animations are provided. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a tracker component that can track virtual location data corresponding to a feature of a computer animated character in a virtual environment. The computer executable components can further comprise a virtual motion sensor component that, based on the virtual location data, can generate virtual motion sensor data.

Virtual generation of labeled motion sensor data

A facial expression feedback system for providing real-time feedback on how closely a user matches his or her facial expression to a target expression is presented. The facial expression feedback system receives sensor data captured by a set of sensors. The facial expression feedback system evaluates the captured sensor data to generate a set of confidence scores with respect to a target facial expression. The system presents the feedback by modifying a multimedia presentation based on the generated set of confidence scores.

Facial mirroring in virtual and augmented reality

A virtual reality (VR) system for VR desk application that allows a user to move in a VR environment while sitting in front of a working desk is provided. The VR system receives sensor data from a mobile device. The VR system generates a set of sitting motion data by interpreting the received sensor data as a motion of a limb of a person in a sitting posture. The VR system maps the set of sitting motion data into a set of movements in the VR environment. The VR system renders the VR environment and presents the rendered VR environment.

Locomotion in virtual reality desk applications

Augmented reality speed reading is provided by detecting a reader's changing gaze direction; detecting movements of the reader's eye; and between movements of the reader's eye, displaying text at the reader's gaze direction. An exemplary apparatus includes an eye illuminator that delivers light to a reader's eye; an eyeward camera that generates digital images of the reader's eye including reflected light from the eye illuminator; a display; and a processor that is connected in communication with the eyeward camera and the display. The processor implements an eye tracking module that receives the digital images from the eyeward camera and detects the reader's gaze direction, and the processor implements a text display module that controls the display to present text at the reader's gaze direction.

Augmented reality speed reading

Techniques that facilitate condition detection in a virtual reality system and/or an augmented reality system are provided. In one example, a system includes a virtual reality component and an anomaly detection component. The virtual reality component collects motion data and biometric data from a virtual reality device. The motion data is indicative of motion information associated with one or more accelerometer sensors of the virtual reality device. The biometric data is indicative of biometric information associated with one or more biometric sensors of the virtual reality device. The anomaly detection component integrates the motion data and the biometric data into a machine learning model to generate anomaly detection data for the virtual reality device.

Growing community of inventors

Greenwich, CT, United States of America

Jenna Reinen