International Business Machines Corporation

Willie L Scott, Ii

Kuntal Dey

Charu Pandhi

Seema Nagar

Puthukode G Ramachandran

Anil U Joshi

Mohit Jain

Soma Shekar Naganna

Thomas Andrew Brunet

Pushpalatha M Hiremath

Sharon D Snider

Provided is a method, computer program product, and system for automatically assigning robotic devices to users based on need using predictive analytics. A processor may monitor activities performed by one or more users. The processor may determine, based on the monitoring, a set of activities that require assistance from a robotic device when being performed by the one or more users. The processor may match the set of activities to a set of capabilities related to a plurality of robotic devices. The processor may identify, based on the matching, a first robotic device that is capable of assisting the one or more users in performing a first activity of the set of activities. The processor may deploy the first robotic device to assist the one or more users in performing the first activity.

Assignment of robotic devices using predictive analytics

In an approach for a conversational search in a content management system, a processor trains a deep learning model to learn semantic analysis of a plurality of user queries to identify intents and entities in the user queries. A processor analyzes the content management system to extract content keywords to generate a domain ontology. A processor augments the domain ontology based on the identified intents and entities in the user queries by the deep learning model. A processor tags the content keywords with metadata based on the domain ontology. A processor maps the intents and entities extracted from a current user query of a user to the content keywords extracted from the content management system to form a metadata keyword. A processor searches the content management system for a content based on the metadata keyword. A processor returns a search result for the current user query.

Conversational search in content management systems

Techniques for translating air writing to augmented reality (AR) devices are described. In one embodiment, a method includes receiving indications of gestures from an originator. The indications identify movement in three dimensions that correspond to an emphasis conferred on one or more words that are air-written by the originator and are configured to be displayed by a plurality of AR devices. The method includes analyzing the identified movement to determine a gesture type associated with the emphasis, where the gesture type includes a first emphasis to be conferred on the air-written words. The method includes providing a display of the air-written words on a first AR device of the plurality of AR devices. The first emphasis is conferred on the words on the display of the first AR device using a first gesture display style based on a profile of a first user utilizing the first AR device.

Method and system for translating air writing to an augmented reality device

A content clarification server receives at least one language element entered by a user into a client computer, where the user works in a first area of specialization. The content clarification server extracts a set of concepts found in the at least one language element, and launches an auction bidding process for replacing original language in the at least one language element to content clarification providers who provide replacement language that clarifies a meaning of the at least one language element. The content clarification server filters out replacement language from content clarification providers that work in a second area of specialization that is different from the first area of specialization in which the user works, and identifies winning replacement language, from the filtered out replacement language, for the original language from one of the content clarification providers. The content clarification server replaces the original language with the winning replacement language.

Real-time on-demand auction based content clarification

Systems, methods, and computer-readable media are disclosed for associating and reconciling disparate key-value pairs corresponding to a target entity across multiple organizational entities using a distributed match. A shared output mapping may be generated that associates and reconciles common and/or conceptually aligned key-value pairs across the multiple organizational entities. The shared output mapping allows any given organizational entity to leverage information known to other organizational entities about a target entity. In this manner, the organizational entities participate in an information sharing ecosystem that enables each organizational entity to provide a user with a more optimally customized user experience based on the greater breadth of information available through the shared output mapping.

Distributed match and association of entity key-value attribute pairs

A method modifies a user interface based on a user having nystagmus. One or more processors collect eye gaze data points of a viewer of a user interface that displays content. The processor(s) determine, based on the eye gaze data points, that the viewer of the user interface has nystagmus. Responsive to determining that the viewer of the user interface has nystagmus based on the eye gaze data points, the processor(s) modifies the user interface.

Modifying a computer-based interaction based on eye gaze

Embodiments herein provide an augmented reality (AR) system that uses sound localization to identify sounds that may be of interest to a user and generates an audio description of the source of the sound as well as AR content that can be magnified and displayed to the user. In one embodiment, an AR device captures images that have the source of the sound within their field of view. Using machine learning (ML) techniques, the AR device can identify the object creating the sound (i.e., the sound source). A description of the sound source and its actions can outputted to the user. In parallel, the AR device can also generate AR content for the sound source. For example, the AR device can magnify the sound source to a size that is viewable to the user and create AR content that is then superimposed onto a display.

Translating sound events to speech and AR content

An approach is provided in which the approach the approach deconstructs a user interface into user interface elements that each are assigned an importance score. The approach compares a user eye gaze pattern of a user viewing the user interface against an expected eye gaze pattern corresponding to the user interface, and determines that the user requires assistance navigating the user interface. The approach selects one of the user interface elements based on its importance score, generates an augmented reality overlay of the selected user interface element, and displays the augmented reality overlay on the user interface using an augmented reality device.

Visual hierarchy design governed user interface modification via augmented reality

Provided are systems, methods, and media for real-time alteration of video. An example method includes presenting a video to a user. The method includes monitoring a gaze point of the user as the user views one or more frames of the video. The method includes, in response to a determination that the monitored gaze point of the user is different from a predetermined target gaze point, changing the orientation of the video to reposition the target gaze point of the video to the monitored gaze point of the user, in which the orientation of the video is changed during the presentation of the video to the user.

Real-time alteration of standard video and immersive video for virtual reality

A gesture to speech conversion device may receive indications of user gestures via at least one sensor, the indications identifying movement in three dimensions. A 2-dimensional (2D) plane on which a beginning of the movement and an end of the movement is substantially planar and a third dimension orthogonal to the 2D plane may be determined. A change of the movement in a direction of the third dimension in a course of the movement occurring on the 2D plane is detected. The change of the movement in the third dimension is mapped to an emphasis in the movement. The movement is transformed into speech with emphasis on a part of the speech corresponding to a part of the movement having the detected change.

Air writing to speech system using gesture and wrist angle orientation for synthesized speech modulation

A method modifies a computer-based interaction based on gaze data. One or more processors collect eye gaze data points to create an eye gaze corpus of information, where the eye gaze data points describe an eye gaze of viewers of a first set of at least one user interface. The processor(s) generate a plurality of clusters of viewers, and determine a target action performance for each of the plurality of clusters. The processor(s) collect, from a device having eye tracking technology, real time eye gaze data from a plurality of current users who are viewing a second set of at least one user interface, and segment the plurality of current users. The processor(s) then modify a computer-based interaction for at least one segment in order to maximize target action performance of the second set of at least one user interface.

A method identifies and filters winning clarifications of content. A content clarification server receives a language element from a client computer, and extracts and marks for clarification a concept among the language element. The content clarification server launches an auction bidding process for replacing original language associated with the concept, and receives sponsored alternatives to the original language from multiple content clarification provider servers. The content clarification server generates an organic alternative, and then assigns a score to each of the sponsored alternatives and the organic alternative. Based upon the respective assigned scores, the content clarification server identifies a winning alternative, which is delivered to the client computer as a replacement for the original language associated with the at least one concept.

Growing community of inventors

Austin, TX, United States of America

Willie L Scott, Ii