International Business Machines Corporation

Apple Inc.

Marco Cavallo

Aldis G Sipolins

Hui Wu

Ravi Tejwani

Jenna Reinen

Patrick D Watson

Arun Srivatsan Rangaprasad

James Christopher Schneider

Tiejian Zhang

Kieran Dimond

Ying Bai

Cagatay Demiralp

James R Kozloski

Stephen John Heisig

Implementations of the subject technology provide visualizations of non-visible features of a physical environment, at the location of the non-visible features in the physical environment. The non-visible features may include wireless communications signals, sounds, airflow, gases, subsonic and/or ultrasonic waves, hidden objects, or the like. A device may store visual contexts for visualizations of particular non-visible features. The device may obtain a depth map that allows the device to determine the location of the non-visible feature in the physical environment and to overlay the visualization on a user's view of that location. In this way, the non-visible feature can be visualized its correct location, orientation, direction and/or strength in the physical environment.

Visualization of non-visible phenomena

A system includes a virtual reality system configured to enable a user to interact with a virtual environment, a plurality of biofeedback sensors configured to monitor a user, and a computer system including a virtual reality module configured to generate at least a view of the virtual environment, a biofeedback module configured to fuse output of the plurality of biofeedback sensors with a plurality of events within the virtual environment, a training module configured to generate a model of user behavior, wherein the training module executed by the computer system enables the computer system to make a prediction of a user response of the user based on a corpus of biofeedback data, and an alert module configured to generate at least one alert to the user via the virtual reality system based on the user response predicted by the computer system.

Building a model based on responses from sensors

A method includes detecting an eye movement of a reader during a reading of presented text; determining, based on whether an eye movement is detected, whether the reader is looking at the presented text; pausing a presentation of the presented text if it is determined that the reader is not looking at the presented text; and resuming, if the presentation of the text is paused, the presentation of the presented text.

Enhanced speed reading with eye tracking and blink detection

Methods and systems of classification model evaluation are described. A processor may generate a classifier track comprising visual indicators representing the set of classifier labels. The classifier labels may be based on output data of a classification model. The processor may generate a label track comprising visual indicators representing a set of observed labels received from a device. The processor may output the classifier track and the label track on a user interface. The processor may receive a request to evaluate the classification model, where the request may indicate a performance metric. The processor may identify a set of operators associated with the performance metric. The processor may execute the identified set of operators on the classifier track and the label track. The processor may generate a performance track indicating the performance metric of the classification model. The processor may output the performance track on the user interface.

Interactive visualization evaluation for classification models

An apparatus includes: a memory embodying three-dimensional data and computer executable instructions; sensors detecting a movable controller in a real space; at least one processor, operative by the computer executable instructions to facilitate: mapping the three dimensional data to a virtual space; tracking a real position and orientation of the movable controller using data from the sensors; converting the real position and orientation into a virtual position and orientation relative to the three dimensional data; identifying a selected region of the three dimensional data, which is tethered to the virtual position and orientation; and rendering the three dimensional data in the virtual space, with the selected region being rendered differently from the remainder of the three dimensional data; and showing a user the rendering of the three dimensional data in the virtual space by activating a virtual or augmented reality display that is activated by the at least one processor.

Visually interacting with three dimensional data in augmented or virtual reality

A data presentation method through augmented reality, system, and computer program product include creating a file container for a presentation that supports raw data embedding and definition of available interactions and levels of confidentiality of information for the presentation, streaming presentation content from the file container to a plurality of augmented reality devices, and generating a personalized individual interactive experience of the presentation content for at least one person wearing an augmented reality device in the plurality of augmented reality devices.

Personalized interactive data presentation through augmented reality

Systems, computer-implemented methods, and computer program products to generate virtual motion sensor data from computer animations are provided. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a tracker component that can track virtual location data corresponding to a feature of a computer animated character in a virtual environment. The computer executable components can further comprise a virtual motion sensor component that, based on the virtual location data, can generate virtual motion sensor data.

Virtual generation of labeled motion sensor data

A facial expression feedback system for providing real-time feedback on how closely a user matches his or her facial expression to a target expression is presented. The facial expression feedback system receives sensor data captured by a set of sensors. The facial expression feedback system evaluates the captured sensor data to generate a set of confidence scores with respect to a target facial expression. The system presents the feedback by modifying a multimedia presentation based on the generated set of confidence scores.

Facial mirroring in virtual and augmented reality

Methods for enhanced exploration of dimensionally reduced data. The method including: obtaining at least one data set having a plurality of data objects, wherein each data object is characterized by a plurality of numerical features; applying a dimensionality reduction technique to the at least one data set; generating a two-dimensional scatter plot of the at least one data set, wherein each data object in the plurality of data objects corresponds to a data point in a plurality of data points in the scatter plot; and altering at least one numerical feature of a data object in the plurality of data objects, wherein a position of the data point corresponding to the data object is affected in real-time, and wherein the remaining data points in the plurality of data points are unaffected. In addition, the present invention provides another method and computer program product.

Enhanced exploration of dimensionally reduced data

A virtual reality (VR) system for VR desk application that allows a user to move in a VR environment while sitting in front of a working desk is provided. The VR system receives sensor data from a mobile device. The VR system generates a set of sitting motion data by interpreting the received sensor data as a motion of a limb of a person in a sitting posture. The VR system maps the set of sitting motion data into a set of movements in the VR environment. The VR system renders the VR environment and presents the rendered VR environment.

Locomotion in virtual reality desk applications

Augmented reality speed reading is provided by detecting a reader's changing gaze direction; detecting movements of the reader's eye; and between movements of the reader's eye, displaying text at the reader's gaze direction. An exemplary apparatus includes an eye illuminator that delivers light to a reader's eye; an eyeward camera that generates digital images of the reader's eye including reflected light from the eye illuminator; a display; and a processor that is connected in communication with the eyeward camera and the display. The processor implements an eye tracking module that receives the digital images from the eyeward camera and detects the reader's gaze direction, and the processor implements a text display module that controls the display to present text at the reader's gaze direction.

Augmented reality speed reading

Techniques that facilitate condition detection in a virtual reality system and/or an augmented reality system are provided. In one example, a system includes a virtual reality component and an anomaly detection component. The virtual reality component collects motion data and biometric data from a virtual reality device. The motion data is indicative of motion information associated with one or more accelerometer sensors of the virtual reality device. The biometric data is indicative of biometric information associated with one or more biometric sensors of the virtual reality device. The anomaly detection component integrates the motion data and the biometric data into a machine learning model to generate anomaly detection data for the virtual reality device.

Growing community of inventors

New York, NY, United States of America

Marco Cavallo